-- Logs begin at Thu 2022-07-14 15:00:17 UTC, end at Thu 2022-07-14 16:22:08 UTC. -- Jul 14 15:47:05.173978 dv-cinder-849869-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:47:05.183566 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:47:05 2022] *** Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: nodename: dv-cinder-849869-1-iscsi Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: machine: x86_64 Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: clock source: unix Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: pcre jit disabled Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: detected number of CPU cores: 4 Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: current working directory: / Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: your processes number limit is 47680 Jul 14 15:47:05.185571 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: your memory page size is 4096 bytes Jul 14 15:47:05.186760 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: detected max file descriptor number: 2048 Jul 14 15:47:05.186760 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: lock engine: pthread robust mutexes Jul 14 15:47:05.186760 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: thunder lock: enabled Jul 14 15:47:05.186760 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:47:05.186760 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:47:05.235031 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: Python main interpreter initialized at 0x55822844d9c0 Jul 14 15:47:05.235031 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: python threads support enabled Jul 14 15:47:05.235031 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: your server socket listen backlog is limited to 100 connections Jul 14 15:47:05.235031 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:47:05.236390 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:47:05.236390 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: *** Operational MODE: preforking *** Jul 14 15:47:05.236390 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:47:05.236390 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: spawned uWSGI master process (pid: 110315) Jul 14 15:47:05.235951 dv-cinder-849869-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:47:05.237093 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: spawned uWSGI worker 1 (pid: 110316, cores: 1) Jul 14 15:47:05.237093 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: spawned uWSGI worker 2 (pid: 110317, cores: 1) Jul 14 15:47:05.237093 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:47:06.001523 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:47:06.043388 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:47:07.178320 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:47:07.178320 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: from cryptography.utils import int_from_bytes Jul 14 15:47:07.178949 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:47:07.178949 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: from cryptography.utils import int_from_bytes Jul 14 15:47:07.181533 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:47:07.181533 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: from cryptography.utils import int_from_bytes Jul 14 15:47:07.181992 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:47:07.181992 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: from cryptography.utils import int_from_bytes Jul 14 15:47:09.676777 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:47:09.677340 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:47:09.677444 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:47:09.677782 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:47:09.677864 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:47:09.677933 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:47:09.678133 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:47:09.678230 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:47:09.678517 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:47:09.678603 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.678775 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:47:09.678874 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679143 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679237 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679460 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679560 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679780 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.679865 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680089 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680208 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680429 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680515 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680740 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.680852 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681063 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681167 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681319 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681403 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681633 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681732 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.681949 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682046 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849869-1-iscsi {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682264 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682362 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682570 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682652 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849869-1-iscsi {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682878 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.682965 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683195 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683288 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683499 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683597 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683818 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.683910 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.684136 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.684490 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.684596 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.684719 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.684863 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685158 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685298 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685466 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685581 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685778 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.685897 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.686115 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.686242 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.686431 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687084 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687295 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687606 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687713 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.687924 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688011 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688347 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688482 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688656 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688754 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.688978 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689113 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849869-1-iscsi {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689356 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689450 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849869-1-iscsi {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689668 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689754 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.689981 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690071 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690297 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690389 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690684 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690820 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.690993 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691101 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691307 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691402 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691624 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691717 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.691948 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692089 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692267 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692352 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692586 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692680 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692904 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.692996 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693222 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693311 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693524 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693618 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693829 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.693914 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694135 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694226 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694447 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694533 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694749 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.694847 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695056 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695152 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695304 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695392 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695595 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695695 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695908 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.695995 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696253 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696342 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696573 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696654 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696826 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.696996 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697087 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697168 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697376 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697475 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697697 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.697783 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698005 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698097 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698311 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698396 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698616 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698708 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.698923 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699008 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699229 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699312 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699534 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699626 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699840 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.699924 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700186 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700378 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700464 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700551 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700784 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.700869 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701097 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701197 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701421 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701519 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.701821 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.702048 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.702793 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.119 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703021 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.119 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703125 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.119 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703276 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.119 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703361 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703586 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.703683 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704199 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704336 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704525 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704631 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704836 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.704934 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705156 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705252 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705462 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705557 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705769 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.705865 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706075 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706177 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706384 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706488 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706704 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.706799 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707005 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707106 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707257 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707359 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707558 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707653 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707864 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.707958 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708192 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708302 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708504 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708605 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708809 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.708909 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709113 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709216 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709414 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709516 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709713 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.709807 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710017 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710124 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710321 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710422 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710622 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710723 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.710927 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711029 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711232 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711331 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711547 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711640 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711837 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.711946 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712158 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712247 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712464 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712551 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712783 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.712868 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713087 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713181 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713390 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713484 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713692 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713777 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.713991 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714083 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714292 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714378 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714602 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714696 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714905 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.714990 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715316 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715447 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715538 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715827 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.715913 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716149 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716248 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716470 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716564 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716776 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.716861 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717081 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717174 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717397 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717491 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717698 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.717817 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718026 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718113 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718344 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718441 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718659 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718752 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.718962 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719049 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719264 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719351 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719566 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719659 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719869 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.719964 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720195 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720285 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720498 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720590 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720797 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.720892 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721101 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721185 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721409 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721493 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721716 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.721812 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722019 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722110 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722321 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722414 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722624 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722717 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.722944 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:47:09.723030 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.723279 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.723364 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.723613 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.723698 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.723929 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724022 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724286 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724374 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724620 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724707 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.724936 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725020 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725250 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725352 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725562 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725652 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725884 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.725968 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726192 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726290 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726502 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726594 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.726897 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727122 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727220 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727438 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727522 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727755 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.727853 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728069 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728173 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728415 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728501 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728730 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.728815 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729038 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729132 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729349 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729434 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729670 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729756 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.729986 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730078 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730300 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730387 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730611 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730697 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.730953 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731048 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731277 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731369 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731601 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731722 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.731920 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732018 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732364 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732580 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732669 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732891 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.732978 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.733201 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.733288 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.733563 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.733654 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.733954 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734041 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734269 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734362 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734591 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734684 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734904 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.734991 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735218 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735310 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735529 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735615 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735846 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.735940 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736182 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736319 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736509 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736603 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736826 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.736912 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737138 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737224 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737451 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737544 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737760 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.737845 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738072 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738155 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738382 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738478 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738690 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738783 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.738995 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739080 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739300 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739394 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739607 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739700 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739908 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.739993 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740245 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740344 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740565 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740651 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740872 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.740957 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741192 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741277 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741506 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741592 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741818 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.741907 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742127 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742220 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742435 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742562 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742741 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.742827 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743046 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743131 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743353 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743439 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743659 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743752 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.743964 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744050 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744298 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744384 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744663 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744856 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.744945 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745023 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745223 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745310 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745530 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745625 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745841 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.745929 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746156 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746252 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746469 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746567 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746779 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.746867 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747092 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747403 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747565 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747713 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.747806 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748027 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748165 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748366 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748453 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748703 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.748794 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.749011 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.749779 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.749909 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.749996 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.750240 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.750396 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.750570 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.750716 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.750892 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751022 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751199 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751331 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751510 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751636 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751816 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.751946 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752151 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752261 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752450 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752574 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752761 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.752878 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753067 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753181 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753374 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753473 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753679 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753774 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.753985 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754071 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754290 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754385 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754614 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754700 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.754923 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755009 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755240 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755340 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755531 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755616 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755832 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.755917 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756197 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756284 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756507 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756592 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756854 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.756954 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757171 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757265 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757491 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757578 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757802 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.757887 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758112 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758204 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758420 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758505 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758730 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.758815 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759037 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759122 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759348 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759432 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759660 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759754 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.759967 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760058 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760303 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760402 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760655 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760761 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.760924 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761010 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761231 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761324 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761545 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761639 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761853 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.761938 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762155 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762239 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762469 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762564 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762813 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.762900 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763125 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763217 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763448 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763535 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763757 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.763843 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.764069 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.764173 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.764408 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.764495 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.765292 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.765393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.765671 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.765756 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.765987 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766167 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766305 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766488 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766616 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766813 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.766934 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767130 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767244 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767453 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767565 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767766 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.767860 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768092 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768214 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768426 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768513 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768748 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.768835 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769055 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769141 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769370 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769456 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769702 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.769788 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770027 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770112 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770338 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770430 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770645 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770730 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.770954 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771048 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771264 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771349 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771573 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771687 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771882 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.771985 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772211 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772318 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772519 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772606 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772825 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.772910 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773133 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773234 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773437 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773530 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773743 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.773829 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774048 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774141 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774355 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774441 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774658 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774750 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.774962 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775059 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775359 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775575 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775660 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.775912 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776165 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776252 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776344 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776546 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776634 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776869 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.776963 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777175 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777261 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777480 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777613 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777803 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.777892 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778104 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778188 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778406 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778498 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778711 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.778798 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779014 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779101 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779328 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779426 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779646 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779745 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.779950 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780037 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780308 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780413 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780626 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780764 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.780938 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781084 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781247 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781404 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781567 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781719 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.781887 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782030 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782197 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782355 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782507 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782673 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782817 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.782986 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783126 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783297 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783435 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783610 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783756 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.783923 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784066 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784264 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784396 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784590 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784690 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784902 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.784996 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.785215 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.785308 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.785527 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.785619 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.785835 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.786153 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.786238 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.786471 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.786557 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.786794 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787034 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787121 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787376 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787468 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787694 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.787781 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788017 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788154 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788366 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788453 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788688 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.788774 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789012 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789113 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789324 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789417 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789631 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789718 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.789938 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790034 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790249 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790342 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790555 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790642 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790862 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.790947 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791166 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791251 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791474 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791558 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791783 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.791868 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792087 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792201 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792422 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792512 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792731 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.792817 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793038 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793164 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793343 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793430 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793650 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793748 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.793965 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794051 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794270 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794364 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794579 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794676 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794883 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.794975 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795186 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795283 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795487 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795582 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795795 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.795879 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796152 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796284 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796478 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796676 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796807 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.796894 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797114 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797238 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797454 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797545 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797785 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.797880 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798130 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798217 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798437 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798523 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798740 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.798833 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799042 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799128 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799349 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799436 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799652 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799737 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.799951 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800036 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800284 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800374 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800593 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800680 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800896 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.800990 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801203 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801294 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801509 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801595 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801815 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.801975 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802118 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802209 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802419 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802504 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802728 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.802821 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803029 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803153 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803329 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803424 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803636 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803731 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.803938 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804030 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804259 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804345 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804567 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804654 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804868 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.804954 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805471 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805556 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805772 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.805858 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806072 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806164 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806376 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806499 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806678 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806773 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.806976 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807105 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807282 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807368 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807589 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807683 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807890 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.807983 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808217 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808308 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808524 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808610 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808826 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.808923 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809125 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809209 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809428 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809514 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.809821 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810034 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810121 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810342 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810427 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810646 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810743 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.810949 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.811035 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.811249 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.811335 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812067 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812219 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812404 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812544 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812712 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.812953 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813047 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813262 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813392 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813567 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813667 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813871 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.813965 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814175 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814262 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814478 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814569 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814782 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.814877 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815086 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815171 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815389 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815475 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815690 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815775 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.815994 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816081 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816327 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816415 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816670 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816757 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.816974 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817061 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817353 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817454 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817605 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817701 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.817919 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818005 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818228 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818314 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818539 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818625 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818842 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.818933 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819153 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819238 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819457 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819766 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.819850 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820069 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820237 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820394 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820482 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820697 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.820783 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821001 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821101 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821310 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821401 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821620 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821705 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.821931 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822026 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822253 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822347 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822553 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822638 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822884 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.822982 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823187 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823280 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823495 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823581 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823804 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.823891 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824149 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824239 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824446 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824533 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824752 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.824883 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825059 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825145 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825369 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825453 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825762 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.825983 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826069 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826291 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826383 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826596 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826727 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826897 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.826989 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.827347 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.827458 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.827582 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.827754 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.827901 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828065 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828235 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828397 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828545 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828704 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.828855 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.829277 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.829424 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.829582 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.829735 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830012 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830106 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830328 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830453 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830642 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830766 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.830952 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831078 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831262 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831423 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831573 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831684 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831888 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.831997 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.832234 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.832341 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.832543 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.832629 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.832936 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833020 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833259 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833352 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833569 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833656 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833877 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.833962 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834183 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834276 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834486 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834573 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834793 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.834879 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835116 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835210 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835420 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835505 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835721 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.835806 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836025 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836124 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836360 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836446 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836663 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836747 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.836974 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837059 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837296 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837421 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837683 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837768 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.837988 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.838075 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.838302 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.838387 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.838700 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.838801 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839007 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839103 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839316 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839414 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839635 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839732 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.839955 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840040 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840291 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840378 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840596 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840690 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840903 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.840995 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.841210 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.841302 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.841533 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.841619 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.841843 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.842006 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.842155 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.842240 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.842457 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.842555 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.843312 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.843422 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.843620 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.843707 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844022 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844157 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844373 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844462 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844771 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.844864 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845097 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845188 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845409 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845496 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845731 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.845817 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846055 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846142 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846360 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846453 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846664 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846757 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.846971 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847057 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847272 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847359 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847575 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847661 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847895 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.847993 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848220 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848323 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848625 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848838 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.848940 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849144 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849239 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849447 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849533 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849752 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.849846 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850060 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850154 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850361 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850453 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850676 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850773 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.850985 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851077 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851302 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851388 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851617 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851703 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.851923 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852011 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852270 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852373 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852578 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852670 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852880 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.852967 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853182 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853275 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853484 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853571 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853789 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.853875 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854122 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854239 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854433 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854520 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854755 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.854842 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855084 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855224 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855395 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855484 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855716 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.855808 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856043 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856160 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856386 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856473 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856705 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.856799 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857024 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857117 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857328 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857420 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857631 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857718 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.857936 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.858028 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.858238 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.858324 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.858662 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.858754 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859005 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859098 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859317 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859410 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859621 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859708 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.859927 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860014 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860252 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860344 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860574 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860660 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860880 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.860975 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861200 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861293 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861507 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861594 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.861898 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862116 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862209 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862417 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862510 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862721 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.862807 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863051 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863135 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863356 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863449 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863688 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.863772 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864005 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864089 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864356 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864454 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864687 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.864773 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865000 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865085 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865326 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865422 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865640 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865724 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.865957 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866049 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866269 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866361 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866582 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866668 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866896 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.866981 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867207 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867299 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867515 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867602 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867824 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.867912 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868160 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868251 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868476 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868562 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868797 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.868995 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.869316 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.869404 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.869628 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.869714 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.869942 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870038 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870255 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870341 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870566 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870651 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870879 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.870973 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871188 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871274 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871499 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871585 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871809 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.871972 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872132 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872224 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872449 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872610 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.872873 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873102 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873189 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873427 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873526 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873762 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.873850 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.874617 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.874715 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.874937 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875024 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875258 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875390 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875576 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875663 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.875931 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876029 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876282 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876370 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876589 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876676 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876903 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.876996 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877217 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877304 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877527 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877613 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877836 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.877933 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878146 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878232 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878457 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878541 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878764 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.878858 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879071 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879157 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879379 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879464 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879687 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.879773 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880000 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880086 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880349 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880450 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880668 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880761 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.880985 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881072 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881299 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881392 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881611 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881702 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.881925 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.882129 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.882443 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.882539 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.882758 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.882852 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883084 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883169 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883409 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883503 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883725 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.883810 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884038 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884140 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884384 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884472 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884691 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884776 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.884995 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885080 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885299 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885385 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885612 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885742 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.885921 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886054 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886226 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886376 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886546 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886688 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886856 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.886993 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.887164 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.887316 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.887483 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.887625 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.887792 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.888192 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.888350 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.888537 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.888696 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.888853 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889016 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889178 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889343 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889504 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.889928 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890128 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890242 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890438 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890531 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890770 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.890865 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891085 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891173 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891397 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891483 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891711 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.891804 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892015 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892133 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892348 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892486 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892657 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892744 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.892962 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893055 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893267 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893353 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893572 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893669 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893874 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.893960 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894178 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894271 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894493 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894585 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894799 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.894885 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895103 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895197 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895409 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895503 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895711 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.895799 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896016 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896119 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896347 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896451 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896656 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896742 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.896966 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897053 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897280 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897374 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897586 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897672 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897889 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.897976 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898192 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898284 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898492 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898576 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898798 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.898883 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899108 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899195 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899453 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899539 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899756 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.899843 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900179 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900388 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900485 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900694 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.900779 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901006 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901092 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901331 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901423 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901645 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901807 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.901955 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.902042 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.902300 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.902387 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.902618 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.902855 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903152 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903278 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903496 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903583 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903824 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.903918 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904181 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904272 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904490 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904576 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904795 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.904891 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.905099 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.905192 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.905950 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906089 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906263 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906354 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906570 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906725 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.906879 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907044 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907187 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907360 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907495 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907681 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907803 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.907996 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908118 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908335 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908422 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908649 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908744 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.908961 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909048 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909272 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909360 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909585 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909672 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909897 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.909985 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910207 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910292 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910515 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910601 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910830 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.910917 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911152 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911244 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911467 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911565 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911781 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.911867 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912089 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912189 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912418 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912520 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912731 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.912817 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913037 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913130 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913347 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913440 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913659 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913746 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.913976 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914061 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914282 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914369 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914614 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914699 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.914923 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915009 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915298 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915384 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915618 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915707 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.915927 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916058 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916272 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916368 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916585 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916670 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916893 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.916986 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917211 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917298 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917522 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917645 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917846 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.917939 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918160 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918302 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918492 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918621 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918813 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.918907 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919117 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919204 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919422 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919515 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919726 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.919813 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920033 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920138 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920374 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920469 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920682 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.920776 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.921580 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.921689 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.921947 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922036 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922260 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922348 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922569 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922660 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922881 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.922973 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923186 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923273 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923489 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923582 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923794 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.923888 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924125 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924214 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924423 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924509 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924725 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.924828 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925029 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925123 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925332 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925419 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925634 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925737 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.925939 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926024 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926238 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926322 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926574 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926673 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926876 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.926963 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927265 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927482 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927577 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927786 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.927872 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928093 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928202 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928469 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928557 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928791 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.928877 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929103 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929189 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929425 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929512 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929734 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.929828 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930056 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930367 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930480 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930682 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930768 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.930993 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931093 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931310 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931395 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931622 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931715 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.931933 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932091 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932269 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932356 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932580 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932669 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932894 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.932992 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933205 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933291 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933515 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933601 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933829 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.933929 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934142 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934227 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934468 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934554 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934776 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.934868 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935099 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935184 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935415 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935507 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935727 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.935815 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.936147 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.936384 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.936469 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937350 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937443 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937525 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937605 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937684 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937773 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937842 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.937917 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938087 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938175 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938402 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938500 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938723 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.938861 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939036 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939156 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939351 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939461 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939671 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939772 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.939990 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940082 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940326 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940418 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940654 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940745 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.940967 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941055 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941297 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941387 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941616 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941703 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.941960 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942048 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942273 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942362 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942599 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942686 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.942910 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.943012 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.943215 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.943304 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.943457 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:47:09.943546 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.943842 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:47:09.944087 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:47:10.006308 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO dbcounter [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Registered counter for database nova_api Jul 14 15:47:10.006867 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Registered counter for database nova_api Jul 14 15:47:10.118982 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.122502 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_db.sqlalchemy.engines [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.126518 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.129600 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writer thread running {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.182288 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.context [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cffebae-9f8f-471d-8503-434362f780eb(cell1) {{(pid=110317) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:47:10.184521 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.context [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cffebae-9f8f-471d-8503-434362f780eb(cell1) {{(pid=110316) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:47:10.186454 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.188603 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.188903 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_concurrency.lockutils [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.189397 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.190478 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_concurrency.lockutils [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.191279 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_concurrency.lockutils [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.191546 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.193534 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_concurrency.lockutils [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.193642 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Registered counter for database nova_cell0 Jul 14 15:47:10.195581 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO dbcounter [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Registered counter for database nova_cell0 Jul 14 15:47:10.197680 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Registered counter for database nova_cell1 Jul 14 15:47:10.199671 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO dbcounter [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Registered counter for database nova_cell1 Jul 14 15:47:10.205936 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.208503 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_db.sqlalchemy.engines [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.209821 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.211379 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.212003 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_db.sqlalchemy.engines [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.214892 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writer thread running {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.353013 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.354198 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writer thread running {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.361988 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Registered counter for database nova_cell0 Jul 14 15:47:10.363472 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO dbcounter [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Registered counter for database nova_cell0 Jul 14 15:47:10.371060 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.375352 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG oslo_db.sqlalchemy.engines [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:47:10.375957 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.379908 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writer thread running {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:47:10.819399 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:47:10.826626 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:47:10.840902 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: WARNING keystonemiddleware.auth_token [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:47:10.848748 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: WARNING keystonemiddleware.auth_token [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:47:11.173033 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:47:11.178974 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:47:11.184209 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55822844d9c0 pid: 110317 (default app) Jul 14 15:47:11.186252 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:11.188023 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] 10.222.0.119 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.002214 Jul 14 15:47:11.188457 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 1/1] 10.222.0.119 () {50 vars in 793 bytes} [Thu Jul 14 15:47:11 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:11.205619 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: WARNING keystonemiddleware.auth_token [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:47:11.211601 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: WARNING keystonemiddleware.auth_token [None req-a2814103-ccde-4d0d-b60c-6aec0b0a1e07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:47:11.216893 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55822844d9c0 pid: 110316 (default app) Jul 14 15:48:31.503029 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:31.504367 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002223 Jul 14 15:48:31.505014 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 2/2] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:31 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:31.526393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_api:SELECT=3 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:31.526393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_cell0:SELECT=3 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:31.526393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_cell1:SELECT=3 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:31.526393 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:32.398548 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-83e2c236-a196-4be9-a2fb-7a56a20e11b5 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:32.428278 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-83e2c236-a196-4be9-a2fb-7a56a20e11b5 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916065 Jul 14 15:48:32.428866 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 1/3] 10.222.0.119 () {60 vars in 1296 bytes} [Thu Jul 14 15:48:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:34.714701 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:34.716360 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-9063bfde-5fa7-4c17-936e-bfc971c60693 None None] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002178 Jul 14 15:48:34.716979 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 3/4] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:35.152934 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-350affa5-6db2-49eb-8cb0-63ef738dbf74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "swap": 0, "disk": 1}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:35.170705 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:48:35.170705 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: warnings.warn(msg) Jul 14 15:48:35.251671 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-350affa5-6db2-49eb-8cb0-63ef738dbf74 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.528034 Jul 14 15:48:35.252258 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 2/5] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:35.267087 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:35.268485 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:35.269324 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell1:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:35.270277 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:35.485025 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-a2c69ac2-5d55-4902-b427-3b3052044b7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:35.487459 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:48:35.487459 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:48:35.611904 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-a2c69ac2-5d55-4902-b427-3b3052044b7d admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351128 Jul 14 15:48:35.612737 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 4/6] 10.222.0.119 () {64 vars in 1340 bytes} [Thu Jul 14 15:48:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:48:37.905699 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-350affa5-6db2-49eb-8cb0-63ef738dbf74 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:37.906724 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-350affa5-6db2-49eb-8cb0-63ef738dbf74 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001488 Jul 14 15:48:37.907142 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 3/7] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:37 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:48:38.579862 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-8c81f97c-8f06-485a-aaa3-98c57c85e305 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:38.597896 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:48:38.597896 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:48:38.702684 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-8c81f97c-8f06-485a-aaa3-98c57c85e305 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.789250 Jul 14 15:48:38.703520 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 5/8] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:38.716127 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-c8867ea7-c8a8-4fc0-a3f9-390ec69b9907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:38.718162 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:48:38.718162 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: warnings.warn(msg) Jul 14 15:48:38.808109 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-c8867ea7-c8a8-4fc0-a3f9-390ec69b9907 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095994 Jul 14 15:48:38.820566 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 4/9] 10.222.0.119 () {64 vars in 1340 bytes} [Thu Jul 14 15:48:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:41.194707 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-8c81f97c-8f06-485a-aaa3-98c57c85e305 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:41.195749 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-8c81f97c-8f06-485a-aaa3-98c57c85e305 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001560 Jul 14 15:48:41.196257 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 6/10] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:41 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:41.603054 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-499a8313-a76e-46c9-9ff9-814d4b5ff450 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:41.686509 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-499a8313-a76e-46c9-9ff9-814d4b5ff450 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.482587 Jul 14 15:48:41.687070 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 5/11] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:48:41.699192 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-b80262ad-052e-4da9-aec2-49627f0e592d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:41.778951 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-b80262ad-052e-4da9-aec2-49627f0e592d admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083510 Jul 14 15:48:41.779637 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 7/12] 10.222.0.119 () {64 vars in 1340 bytes} [Thu Jul 14 15:48:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:48:44.043170 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-499a8313-a76e-46c9-9ff9-814d4b5ff450 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:44.044138 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-499a8313-a76e-46c9-9ff9-814d4b5ff450 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Jul 14 15:48:44.044950 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 6/13] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:44 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:44.477951 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-2a813988-95eb-494f-b33b-f9e6ed76ff04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:44.560261 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-2a813988-95eb-494f-b33b-f9e6ed76ff04 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509116 Jul 14 15:48:44.561593 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 8/14] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:44.580554 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-3b9d3c24-dcf5-49ea-b55a-d841a4ce026e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:44.706632 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-3b9d3c24-dcf5-49ea-b55a-d841a4ce026e admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134972 Jul 14 15:48:44.715250 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 7/15] 10.222.0.119 () {64 vars in 1340 bytes} [Thu Jul 14 15:48:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:47.009129 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-2a813988-95eb-494f-b33b-f9e6ed76ff04 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:47.015584 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-2a813988-95eb-494f-b33b-f9e6ed76ff04 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Jul 14 15:48:47.015584 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 9/16] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:47.423547 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "swap": 0, "id": "d4"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:47.667078 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.650157 Jul 14 15:48:47.667993 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 8/17] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:47.681309 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-c2f1ad53-38a7-496b-99e1-1d72a6f63630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:47.882873 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-c2f1ad53-38a7-496b-99e1-1d72a6f63630 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.205990 Jul 14 15:48:47.883466 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 10/18] 10.222.0.119 () {64 vars in 1340 bytes} [Thu Jul 14 15:48:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:50.127700 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:50.128843 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001581 Jul 14 15:48:50.129244 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 9/19] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:50 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:50.574536 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-af316253-61a9-48b9-919d-55b9fd55b7ab admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:50.600353 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-af316253-61a9-48b9-919d-55b9fd55b7ab admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.464584 Jul 14 15:48:50.600934 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 11/20] 10.222.0.119 () {60 vars in 1296 bytes} [Thu Jul 14 15:48:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:48:52.905198 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:52.906210 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-edfb24d2-aafd-44d0-bdc1-3686e5905631 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001453 Jul 14 15:48:52.906610 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 10/21] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:53.397485 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-59a84ad6-8580-4562-b53c-d5e242cb4aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:53.558718 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-59a84ad6-8580-4562-b53c-d5e242cb4aff admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.646286 Jul 14 15:48:53.559520 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 12/22] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:48:53.572442 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-dac7ff37-8711-4f6c-aa4f-69fcf13e512c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:53.659784 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-dac7ff37-8711-4f6c-aa4f-69fcf13e512c admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091317 Jul 14 15:48:53.660390 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 11/23] 10.222.0.119 () {64 vars in 1337 bytes} [Thu Jul 14 15:48:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:55.949505 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-59a84ad6-8580-4562-b53c-d5e242cb4aff admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:55.950537 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-59a84ad6-8580-4562-b53c-d5e242cb4aff admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001521 Jul 14 15:48:55.951507 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 13/24] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:56.353811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-4b8da6ea-31e2-4241-ba93-63fd2296ec30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "2", "disk": 20, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:56.441560 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-4b8da6ea-31e2-4241-ba93-63fd2296ec30 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483625 Jul 14 15:48:56.442244 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 12/25] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:48:56.454516 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-1eadafb7-156f-4c85-a8b6-b5f56ef32198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:56.601580 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-1eadafb7-156f-4c85-a8b6-b5f56ef32198 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.151426 Jul 14 15:48:56.602170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 14/26] 10.222.0.119 () {64 vars in 1337 bytes} [Thu Jul 14 15:48:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:58.902349 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-4b8da6ea-31e2-4241-ba93-63fd2296ec30 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:58.903481 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-4b8da6ea-31e2-4241-ba93-63fd2296ec30 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001651 Jul 14 15:48:58.905200 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 13/27] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:48:58 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:59.273500 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6382f36a-d0b7-480b-b852-a9378edc5ffc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:59.344779 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6382f36a-d0b7-480b-b852-a9378edc5ffc admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.433609 Jul 14 15:48:59.345358 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 15/28] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:48:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:48:59.357362 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-32862071-5889-4228-a546-5a6a95334123 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:59.501314 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-32862071-5889-4228-a546-5a6a95334123 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147803 Jul 14 15:48:59.502216 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 14/29] 10.222.0.119 () {64 vars in 1337 bytes} [Thu Jul 14 15:48:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:01.789030 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6382f36a-d0b7-480b-b852-a9378edc5ffc admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:01.790039 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6382f36a-d0b7-480b-b852-a9378edc5ffc admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Jul 14 15:49:01.790432 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 16/30] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:49:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:02.304672 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-09dbadc8-29c1-474e-abbc-68d7a7ae27b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "swap": 0}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:02.309499 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:02.403788 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-09dbadc8-29c1-474e-abbc-68d7a7ae27b0 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.607122 Jul 14 15:49:02.404563 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 15/31] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:49:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:02.416456 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-35c8187e-450a-47eb-96a9-3d56392b20a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:03.413817 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-35c8187e-450a-47eb-96a9-3d56392b20a8 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 1.001018 Jul 14 15:49:03.428737 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 17/32] 10.222.0.119 () {64 vars in 1337 bytes} [Thu Jul 14 15:49:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:05.685554 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-09dbadc8-29c1-474e-abbc-68d7a7ae27b0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:05.686649 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-09dbadc8-29c1-474e-abbc-68d7a7ae27b0 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001949 Jul 14 15:49:05.687055 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 16/33] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:49:05 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:06.160011 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:06.245367 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.551999 Jul 14 15:49:06.248162 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 18/34] 10.222.0.119 () {64 vars in 1287 bytes} [Thu Jul 14 15:49:05 2022] POST /compute/v2.1/flavors => generated 410 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:06.261247 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-852fff41-a06e-41b8-930c-f513a4c49f4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:06.353980 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-852fff41-a06e-41b8-930c-f513a4c49f4d admin admin] 10.222.0.119 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099358 Jul 14 15:49:06.354882 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 17/35] 10.222.0.119 () {64 vars in 1337 bytes} [Thu Jul 14 15:49:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:26.209116 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:26.210112 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001442 Jul 14 15:49:26.210504 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 19/36] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:49:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:26.602135 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-426d1d99-d340-42c5-af8a-18002f31f25b admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:26.618946 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-426d1d99-d340-42c5-af8a-18002f31f25b admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.401707 Jul 14 15:49:26.619471 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 18/37] 10.222.0.119 () {60 vars in 1296 bytes} [Thu Jul 14 15:49:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:27.761776 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:27.762779 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-38f1e32a-4230-4f05-9897-0bfb198c12c7 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001426 Jul 14 15:49:27.763968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 20/38] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:27 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:28.292126 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-9b51d286-ee6d-4112-ba6b-8fe37c77f2c9 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:28.297661 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.wsgi [None req-9b51d286-ee6d-4112-ba6b-8fe37c77f2c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-9b51d286-ee6d-4112-ba6b-8fe37c77f2c9 admin admin] Request method failure captured: Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept: application/json Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept-Encoding: gzip, deflate Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Connection: keep-alive Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Content-Length: 0 Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Host: 10.222.0.119 Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-System-Scope: None Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: User-Agent: python-novaclient Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Auth-Token: gAAAAABi0DsHK_XT92xHQ2gYFp9mEaPNvZEou0FA48sR96pETGsbpmRVAFQiyLsWyhqiOwldRC5bhB5O6UVg4Yv67kB4rF_Qj2vtB7IUAUKTMzjJ50GsN7X8dVYSr5zINo5QuosArblFXO2VCbn_SgjHouXf6okg-sr8-UC5e0zk4gI7JRA4CoI Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Id: None Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Name: None Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Identity-Status: Confirmed Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Is-Admin-Project: True Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Id: default Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Name: Default Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Name: admin Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Role: reader,member,admin Jul 14 15:49:28.301342 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Roles: reader,member,admin Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant: admin Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Name: admin Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User: admin Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Id: default Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Name: Default Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Name: admin Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: method: > Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: exception: Flavor 42 could not be found. Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: action_args: {'id': '42'} Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:28.303107 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:28.304179 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.305552 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-9b51d286-ee6d-4112-ba6b-8fe37c77f2c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:28.306890 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-9b51d286-ee6d-4112-ba6b-8fe37c77f2c9 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401787 Jul 14 15:49:28.306890 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 19/39] 10.222.0.119 () {60 vars in 1195 bytes} [Thu Jul 14 15:49:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:28.312634 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-9940c8c0-9ca3-4bba-bee2-e099e5bd248a admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:28.315545 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:28.334972 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-9940c8c0-9ca3-4bba-bee2-e099e5bd248a admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026114 Jul 14 15:49:28.335516 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 21/40] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:28.345783 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-90bc88a0-726d-450f-9f0f-1e7f1b96f4ea admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:28.366687 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-90bc88a0-726d-450f-9f0f-1e7f1b96f4ea admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024446 Jul 14 15:49:28.367223 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 20/41] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:49:28.377318 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e95a4f6a-3f3a-4e23-b88c-ec13228fc9bc admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:28.383258 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-e95a4f6a-3f3a-4e23-b88c-ec13228fc9bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e95a4f6a-3f3a-4e23-b88c-ec13228fc9bc admin admin] Request method failure captured: Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.119 Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi0DsHK_XT92xHQ2gYFp9mEaPNvZEou0FA48sR96pETGsbpmRVAFQiyLsWyhqiOwldRC5bhB5O6UVg4Yv67kB4rF_Qj2vtB7IUAUKTMzjJ50GsN7X8dVYSr5zINo5QuosArblFXO2VCbn_SgjHouXf6okg-sr8-UC5e0zk4gI7JRA4CoI Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Role: reader,member,admin Jul 14 15:49:28.390380 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,member,admin Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: method: > Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: exception: Flavor 42 could not be found. Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '42'} Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:28.391778 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:28.392693 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:28.393729 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e95a4f6a-3f3a-4e23-b88c-ec13228fc9bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:28.394769 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-e95a4f6a-3f3a-4e23-b88c-ec13228fc9bc admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014184 Jul 14 15:49:28.394769 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 22/42] 10.222.0.119 () {60 vars in 1195 bytes} [Thu Jul 14 15:49:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:29.387137 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-90bc88a0-726d-450f-9f0f-1e7f1b96f4ea admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:29.388206 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-90bc88a0-726d-450f-9f0f-1e7f1b96f4ea admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001461 Jul 14 15:49:29.388762 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 21/43] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:29 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:29.953715 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-decea284-d75f-4cf8-8709-604ddf08fbe8 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:29.958928 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-decea284-d75f-4cf8-8709-604ddf08fbe8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-decea284-d75f-4cf8-8709-604ddf08fbe8 admin admin] Request method failure captured: Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.119 Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi0DsJ15h8d6rk9W2Esdtg9O7opTD2dZ-GBU7zXS7uUnNsecXntDV4PUViF5WykX6zKTPhHNPK2FTa8gpdVfsnKfkrxcReYfK3ZJNswqM4h8b6w_hfhDD1oFFgLhkB3CoIZT97kCm2ErflSd10f3lniPKx_VBqOWA80PPYVEoi633KIWc Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Role: reader,member,admin Jul 14 15:49:29.960472 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,member,admin Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: method: > Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: exception: Flavor 84 could not be found. Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '84'} Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:29.962266 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:29.963170 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:29.964467 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-decea284-d75f-4cf8-8709-604ddf08fbe8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:29.965828 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-decea284-d75f-4cf8-8709-604ddf08fbe8 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412161 Jul 14 15:49:29.965828 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 23/44] 10.222.0.119 () {60 vars in 1195 bytes} [Thu Jul 14 15:49:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:29.971750 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-7115a0d0-8bf4-4f3d-bf7c-b3b2da3d6490 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:29.985484 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-7115a0d0-8bf4-4f3d-bf7c-b3b2da3d6490 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017361 Jul 14 15:49:29.986016 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 22/45] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:29.995523 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-dfb14d93-26d3-493b-bcfb-99599112c6af admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:30.009628 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-dfb14d93-26d3-493b-bcfb-99599112c6af admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017820 Jul 14 15:49:30.010160 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 24/46] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:30.020084 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-6eb84c63-b370-446b-b7be-6ec84ba65d60 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:30.025496 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.wsgi [None req-6eb84c63-b370-446b-b7be-6ec84ba65d60 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-6eb84c63-b370-446b-b7be-6ec84ba65d60 admin admin] Request method failure captured: Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept: application/json Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept-Encoding: gzip, deflate Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Connection: keep-alive Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Content-Length: 0 Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Host: 10.222.0.119 Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-System-Scope: None Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: User-Agent: python-novaclient Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Auth-Token: gAAAAABi0DsJ15h8d6rk9W2Esdtg9O7opTD2dZ-GBU7zXS7uUnNsecXntDV4PUViF5WykX6zKTPhHNPK2FTa8gpdVfsnKfkrxcReYfK3ZJNswqM4h8b6w_hfhDD1oFFgLhkB3CoIZT97kCm2ErflSd10f3lniPKx_VBqOWA80PPYVEoi633KIWc Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Id: None Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Name: None Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Identity-Status: Confirmed Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Is-Admin-Project: True Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Id: default Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Name: Default Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Name: admin Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Role: reader,member,admin Jul 14 15:49:30.027058 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Roles: reader,member,admin Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant: admin Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Name: admin Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User: admin Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Id: default Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Name: Default Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Name: admin Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: method: > Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: exception: Flavor 84 could not be found. Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: action_args: {'id': '84'} Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:30.028627 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:30.029530 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:30.030811 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-6eb84c63-b370-446b-b7be-6ec84ba65d60 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:30.032323 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-6eb84c63-b370-446b-b7be-6ec84ba65d60 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011827 Jul 14 15:49:30.032323 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 23/47] 10.222.0.119 () {60 vars in 1195 bytes} [Thu Jul 14 15:49:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:31.009244 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-dfb14d93-26d3-493b-bcfb-99599112c6af admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.010241 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-dfb14d93-26d3-493b-bcfb-99599112c6af admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001426 Jul 14 15:49:31.010627 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 25/48] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:31.535622 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-cc546cfe-2c2d-404c-909d-6916be9a5865 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.541345 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.wsgi [None req-cc546cfe-2c2d-404c-909d-6916be9a5865 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-cc546cfe-2c2d-404c-909d-6916be9a5865 admin admin] Request method failure captured: Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept: application/json Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Accept-Encoding: gzip, deflate Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Connection: keep-alive Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Content-Length: 0 Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Host: 10.222.0.119 Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Openstack-System-Scope: None Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: User-Agent: python-novaclient Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Auth-Token: gAAAAABi0DsKsBnOuhzQbXTzT6oGP1JElQn0-b0pz-0FBcHygstlXwt6KLj4IfPnMFkMz7WpqK8YPUC30jstd5JXqXRiwyCqOKWnkO4lBBZZxm82v4MUZCfSgoMcaF7Y7C7qiCcef1z821KNGIU2MZzx36NCQKvh1zepQCsgx4NINq_n2NilCkM Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Id: None Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Domain-Name: None Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Identity-Status: Confirmed Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Is-Admin-Project: True Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Id: default Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Domain-Name: Default Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Project-Name: admin Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Role: reader,member,admin Jul 14 15:49:31.542840 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Roles: reader,member,admin Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant: admin Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-Tenant-Name: admin Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User: admin Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Id: default Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Domain-Name: Default Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: X-User-Name: admin Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: method: > Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: exception: Flavor 451 could not be found. Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: action_args: {'id': '451'} Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:31.544343 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:31.545151 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.546255 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-cc546cfe-2c2d-404c-909d-6916be9a5865 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:31.547242 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-cc546cfe-2c2d-404c-909d-6916be9a5865 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394873 Jul 14 15:49:31.547242 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 24/49] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:31.553842 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-fb763a3e-6e49-4879-9634-608f5b65e0b0 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.567929 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-fb763a3e-6e49-4879-9634-608f5b65e0b0 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017681 Jul 14 15:49:31.568516 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 26/50] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:31.578880 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.594039 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019712 Jul 14 15:49:31.594570 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 25/51] 10.222.0.119 () {60 vars in 1215 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:31.604494 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-90eacec9-a86c-4311-8e17-5fc6d96da928 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.609906 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-90eacec9-a86c-4311-8e17-5fc6d96da928 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-90eacec9-a86c-4311-8e17-5fc6d96da928 admin admin] Request method failure captured: Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.119 Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi0DsKsBnOuhzQbXTzT6oGP1JElQn0-b0pz-0FBcHygstlXwt6KLj4IfPnMFkMz7WpqK8YPUC30jstd5JXqXRiwyCqOKWnkO4lBBZZxm82v4MUZCfSgoMcaF7Y7C7qiCcef1z821KNGIU2MZzx36NCQKvh1zepQCsgx4NINq_n2NilCkM Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Role: reader,member,admin Jul 14 15:49:31.611395 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,member,admin Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a12def5ec62e451d99b7e6dd6faef1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a12def5ec62e451d99b7e6dd6faef1ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a12def5ec62e451d99b7e6dd6faef1ba"}]}] Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: a12def5ec62e451d99b7e6dd6faef1ba Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Id: 558923a0ab794e4fab69165d8d72902b Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: method: > Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: exception: Flavor 451 could not be found. Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '451'} Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:31.612968 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:31.614004 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 14 15:49:31.615281 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-90eacec9-a86c-4311-8e17-5fc6d96da928 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:31.616526 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-90eacec9-a86c-4311-8e17-5fc6d96da928 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012325 Jul 14 15:49:31.616526 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 27/52] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:32.599048 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:32.600056 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Jul 14 15:49:32.600472 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 26/53] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:32 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:33.124595 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-4f14bad7-ef51-47b5-9f9c-1bcf17c4bf98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:33.198660 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-4f14bad7-ef51-47b5-9f9c-1bcf17c4bf98 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.461881 Jul 14 15:49:33.199215 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 28/54] 10.222.0.119 () {64 vars in 1240 bytes} [Thu Jul 14 15:49:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:34.184410 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:34.185468 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001514 Jul 14 15:49:34.185864 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 27/55] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:34.722338 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-9f17dbae-ddf7-49e2-a99e-569f69641e97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:34.795962 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-9f17dbae-ddf7-49e2-a99e-569f69641e97 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.470698 Jul 14 15:49:34.796542 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 29/56] 10.222.0.119 () {64 vars in 1240 bytes} [Thu Jul 14 15:49:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:35.771111 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:35.772128 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001416 Jul 14 15:49:35.772531 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 28/57] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:35 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:36.293237 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5d1f4b64-6a73-40cb-89bb-1e87adf050f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:36.391969 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-5d1f4b64-6a73-40cb-89bb-1e87adf050f9 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.480881 Jul 14 15:49:36.392623 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 30/58] 10.222.0.119 () {64 vars in 1240 bytes} [Thu Jul 14 15:49:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:37.377212 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:37.378258 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001481 Jul 14 15:49:37.378656 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 29/59] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:37 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:37.901449 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-ed233190-57f0-4b21-9c1a-061473c27078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:37.982185 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-ed233190-57f0-4b21-9c1a-061473c27078 admin admin] 10.222.0.119 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.464550 Jul 14 15:49:37.982730 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 31/60] 10.222.0.119 () {64 vars in 1240 bytes} [Thu Jul 14 15:49:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:49:38.959753 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:38.960801 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001538 Jul 14 15:49:38.961197 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 30/61] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:49:38 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:39.490108 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-4922189b-4aa3-449e-ad72-b632b23314c4 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:39.509800 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-4922189b-4aa3-449e-ad72-b632b23314c4 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.411513 Jul 14 15:49:39.510336 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 32/62] 10.222.0.119 () {60 vars in 1207 bytes} [Thu Jul 14 15:49:39 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:50:32.477214 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:32.478263 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-82e8e72e-1ac5-4bdf-914d-070ce50c6a15 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001645 Jul 14 15:50:32.478658 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 31/63] 10.222.0.119 () {54 vars in 935 bytes} [Thu Jul 14 15:50:32 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:32.489237 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:33.008368 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-f48aa668-4c4c-4cd9-b74b-c54b438d5368 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.027760 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-f48aa668-4c4c-4cd9-b74b-c54b438d5368 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.542892 Jul 14 15:50:33.028284 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 33/64] 10.222.0.119 () {60 vars in 1296 bytes} [Thu Jul 14 15:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:50:33.048760 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG dbcounter [-] [110316] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:33.052476 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-eda4456a-8226-4263-8855-ae7666f219f3 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.060869 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-eda4456a-8226-4263-8855-ae7666f219f3 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013583 Jul 14 15:50:33.061556 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 32/65] 10.222.0.119 () {60 vars in 1287 bytes} [Thu Jul 14 15:50:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:33.074810 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-b1b1f5c2-eb6a-48de-a381-1dd3a730d689 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.083751 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-b1b1f5c2-eb6a-48de-a381-1dd3a730d689 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012604 Jul 14 15:50:33.084297 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 34/66] 10.222.0.119 () {60 vars in 1290 bytes} [Thu Jul 14 15:50:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:33.096635 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.104421 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011693 Jul 14 15:50:33.111784 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 33/67] 10.222.0.119 () {60 vars in 1290 bytes} [Thu Jul 14 15:50:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:33.116341 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-f5c2ac73-5d30-481d-a77c-d79ed7744118 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.124551 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-f5c2ac73-5d30-481d-a77c-d79ed7744118 admin admin] 10.222.0.119 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011740 Jul 14 15:50:33.125062 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 35/68] 10.222.0.119 () {60 vars in 1287 bytes} [Thu Jul 14 15:50:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:10.767075 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:10.768015 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001436 Jul 14 15:54:10.768442 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 34/69] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:54:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:10.910412 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=6 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:11.077374 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:11.078539 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:54:11.078539 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:54:11.079728 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.080533 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.081315 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.081739 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.115490 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-4dfcd61c-f141-474b-8165-1759b90c1aa5 admin admin] 10.222.0.119 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206429 Jul 14 15:54:11.116037 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 36/70] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:54:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:54:11.949872 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:11.950905 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001418 Jul 14 15:54:11.951296 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 35/71] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:54:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:12.141429 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:12.142598 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:54:12.142598 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:54:12.143788 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:12.144274 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:12.145043 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:12.146092 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:12.165733 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-051c6277-0c47-43e2-9e20-a474bd200c16 admin admin] 10.222.0.119 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075408 Jul 14 15:54:12.166300 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 37/72] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:54:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:54:23.429495 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:23.431070 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001980 Jul 14 15:54:23.431470 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 36/73] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:54:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:23.571545 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.572318 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell1:SELECT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.572938 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=8 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.628435 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:23.629551 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:54:23.629551 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:54:23.631426 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:23.631982 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:23.632930 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:23.633527 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:23.659616 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-4a65fb98-bc1e-41f6-9b75-8f03ef4b8ecd admin admin] 10.222.0.119 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088744 Jul 14 15:54:23.660198 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 38/74] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:54:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:54:24.499011 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: DEBUG nova.api.openstack.wsgi [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] Calling method '>' {{(pid=110316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:24.500040 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: INFO nova.api.openstack.requestlog [None req-71dbcb14-872d-4c53-997d-17111a2caff0 admin admin] 10.222.0.119 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001417 Jul 14 15:54:24.500475 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: [pid: 110316|app: 0|req: 37/75] 10.222.0.119 () {56 vars in 1079 bytes} [Thu Jul 14 15:54:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:24.696589 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:24.697761 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:54:24.697761 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 14 15:54:24.698964 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:24.699396 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:24.700212 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:24.700635 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:24.722083 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-d4e2b4c6-211d-4525-af27-b3e7c1ade178 admin admin] 10.222.0.119 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078200 Jul 14 15:54:24.722618 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 39/76] 10.222.0.119 () {60 vars in 1198 bytes} [Thu Jul 14 15:54:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:26.709754 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: Thu Jul 14 15:55:26 2022 - graceful shutdown triggered... Jul 14 15:55:26.710238 dv-cinder-849869-1-iscsi devstack@n-api.service[110317]: Gracefully killing worker 2 (pid: 110317)... Jul 14 15:55:26.710662 dv-cinder-849869-1-iscsi devstack@n-api.service[110316]: Gracefully killing worker 1 (pid: 110316)... Jul 14 15:55:26.711960 dv-cinder-849869-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 15:55:27.710906 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: worker 1 buried after 1 seconds Jul 14 15:55:27.711430 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: worker 2 buried after 1 seconds Jul 14 15:55:27.711430 dv-cinder-849869-1-iscsi devstack@n-api.service[110315]: goodbye to uWSGI. Jul 14 15:55:27.712552 dv-cinder-849869-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 15:55:27.713105 dv-cinder-849869-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 15:55:27.716123 dv-cinder-849869-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:55:27.726605 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:55:27 2022] *** Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: nodename: dv-cinder-849869-1-iscsi Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: machine: x86_64 Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: clock source: unix Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: pcre jit disabled Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: detected number of CPU cores: 4 Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: current working directory: / Jul 14 15:55:27.728628 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: your processes number limit is 47680 Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: your memory page size is 4096 bytes Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: detected max file descriptor number: 2048 Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: lock engine: pthread robust mutexes Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: thunder lock: enabled Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:55:27.729485 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:55:27.773980 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: Python main interpreter initialized at 0x556a9e3149c0 Jul 14 15:55:27.773980 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: python threads support enabled Jul 14 15:55:27.773980 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: your server socket listen backlog is limited to 100 connections Jul 14 15:55:27.773980 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:55:27.774382 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:55:27.774382 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: *** Operational MODE: preforking *** Jul 14 15:55:27.774731 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:55:27.774731 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: spawned uWSGI master process (pid: 125252) Jul 14 15:55:27.774819 dv-cinder-849869-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:55:27.778067 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: spawned uWSGI worker 1 (pid: 125266, cores: 1) Jul 14 15:55:27.778642 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: spawned uWSGI worker 2 (pid: 125267, cores: 1) Jul 14 15:55:27.778981 dv-cinder-849869-1-iscsi devstack@n-api.service[125252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:55:28.468713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:55:28.486580 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:55:29.723287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:55:29.723287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: from cryptography.utils import int_from_bytes Jul 14 15:55:29.724058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:55:29.724058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: from cryptography.utils import int_from_bytes Jul 14 15:55:29.732845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:55:29.732845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: from cryptography.utils import int_from_bytes Jul 14 15:55:29.733339 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:55:29.733339 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: from cryptography.utils import int_from_bytes Jul 14 15:55:32.083686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:55:32.084420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:55:32.084600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:55:32.084933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:55:32.085192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:55:32.085588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.085920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.086298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.086624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.086960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.087276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.087597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.087916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.088279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.088544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.088864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.089189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849869-1-iscsi {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.089511 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.089819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.090131 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.090448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.090764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.091074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.091378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.091873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.093266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.093266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.093266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.093651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.093914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.094215 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.094536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.094849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.095174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.095492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.095904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849869-1-iscsi {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.096252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.096583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.096893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.097297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.097610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.097928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.098240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.098562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.098915 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.099234 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.099641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.099981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.100318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.100619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.100934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.101250 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.101572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.101885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.102191 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.102451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.102756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.103080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.103403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.103726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.103979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.104258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.104575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.104896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.105206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.105521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.105831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.106140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.106450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.106760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.107070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.107389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.107700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.108018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.108366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.108675 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.108994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.109391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.119 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.109646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.119 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.109955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.110295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.110618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.110932 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.111281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.111570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.111892 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.112211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.112523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.112848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.113182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.113489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.113740 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.114047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.114962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.115400 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.115721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.116037 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.116378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.116688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.117000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.117314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.117630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.117944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.118253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.118562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.118874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.119183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.119491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.119815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.120159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.120473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.120783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.121090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.121400 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.121724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.122033 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.122343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.122664 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.122975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.123279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.123599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.123907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.124237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.124558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.124860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.125173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.125492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.125801 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.126109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.126413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.126717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.127019 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.127325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.127628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.127936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.128255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.128576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.128885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.129196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.129504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.130686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.130886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.131313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.131655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.132008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.132350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.132692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.133028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.133353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.133673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.134005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.134329 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.134643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.134958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.135275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.135604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.136016 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.136282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.136603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.136923 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.137245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.137559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.137882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.138218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.138543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.138857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.139202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.139547 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.139863 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.140212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.140540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.140855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.141161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.141542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.141834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.142171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.142490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.142812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.143131 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.143443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.143754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.144067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.144406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.144747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.145066 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.145391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.145780 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.146154 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.146469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.146784 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.147098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.147406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.147713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.148019 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.148355 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.148718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.149047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.149379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.149689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.150025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.150333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.151005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.151005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.151315 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.151699 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.151879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.152187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.152720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.152993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.153170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.153422 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.153747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.154054 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.154362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.154678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.154989 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.155300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.155621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.155782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:55:32.156356 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.156507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:55:32.156671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.156819 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:55:32.156962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.156962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.157256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:55:32.157256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:55:32.157559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.157708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.157860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.158014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.158170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.158317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.158575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.158734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.158888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.158888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.159178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.159344 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.159490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.159643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.159798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.159950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.160126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.160290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.160445 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.160590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.161043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.161207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.161472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.161959 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.162154 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849869-1-iscsi {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.162386 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.162560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.162560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.162986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.163244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.163410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.163648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.163798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.163944 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.164110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.164275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.164420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.164600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.164753 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.164753 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.165044 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.165208 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.165353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.165529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.165763 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.165960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.166110 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.166262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.166434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.166599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.166746 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.166897 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.167050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.167195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.167425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.167573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.167718 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.167861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.168006 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.168189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.168351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.168514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.168763 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849869-1-iscsi {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.168911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.169165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.169325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.169478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.169623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.169767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.169922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.170080 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.170243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.170388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.170544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.170697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.170841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.170995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.171148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.171294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.171445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.171597 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.171742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.172153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.172311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.172551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.172711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.172882 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.173140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.173395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.173562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.173798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.173957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.174104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.174256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.174402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.174556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.174714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.174871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.175033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.175313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.175502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.175665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.175895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.176054 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.176244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.176403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.176576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.176731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.177440 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.177621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.177776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.178079 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.178250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.178408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.178595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.178773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.179041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.179205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.179352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.179508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.179662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.179816 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.179969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.180161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.180325 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.180470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.180621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.180621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.180908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.181063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.181207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.181359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.181503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.181647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.181791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.181968 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.182332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.182486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.182729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.182879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.183038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.183038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.183546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.183706 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.183956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.184192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.184361 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.119 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.184594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.184760 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.119 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.184907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.185051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.185202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.185450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.185611 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.185766 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.185929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.186161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.186325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.186481 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.186638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.186784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.186944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.187090 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.187243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.187399 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.187543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.187688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.187880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.188080 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.188266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.188421 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.188565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.189021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.189256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.189418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.189574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.189720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.189865 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.190010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.190155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.190307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.190471 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.190616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.190768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.190928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.191073 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.191229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.191383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.191536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.191687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.191839 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.191984 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.192174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.192627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.193024 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.193176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.193340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.193605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.193866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.194116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.194288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.194443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.194598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.194750 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.194913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.195058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.195212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.195366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.195604 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.195755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.195910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.196068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.196327 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.196479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.196637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.196810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.196959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.197105 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.197336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.197498 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.197645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.197789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.197941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.198094 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.198249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.198249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.198546 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.198700 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.198845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.198998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.198998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.199381 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.199542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.199542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.199542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.199954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.200344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.200344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.200691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.200838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.200838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.201171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.201329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.201329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.201602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.201748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.201748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.202038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.202186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.202342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.202625 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.202874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.203041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.203278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.203430 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.203600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.203909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.206870 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.207841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.207841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.207841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.207841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.207841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:55:32.211777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.211938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.212086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.212326 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.212486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.212741 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.212998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.213149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.214130 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.214312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.214577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.214731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.214934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.215089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.215243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.215448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.215607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.215874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.216836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.216998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.217991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.219854 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220061 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.220866 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.221896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.222924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.223172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.223325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.223479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.223648 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.224668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.224851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.224851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.224851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.224851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.225540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.225694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.225887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.226117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.226117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.226406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.226551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.226695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227031 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227195 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.227945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.228887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.229936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230261 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.230887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.231901 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.232898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.233237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.233401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.233557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.233712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.233871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.234024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.234171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.234335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.234509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.234916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235076 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.235981 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.236165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.236391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.236540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.236711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.236865 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.237178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.237332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.237487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.237716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.237864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238017 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238163 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.238931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239421 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239637 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239799 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.239987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.240947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.241269 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.241431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.241602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.241833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.242960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.243239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.243486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.243659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.243813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.243972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.244157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.244325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.244489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.244642 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.244961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.245216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.245464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.245628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.245805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.245958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246110 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246269 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.246987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.247235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.247492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.247651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.247813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.247975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248331 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.248984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.249137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.249297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.249450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.249600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.249842 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250646 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.250972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.251132 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.251293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.251445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.251597 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.251763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.252014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.252214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.252815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.252995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.253172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.253423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.253676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.253834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.253986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.254139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.254305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.254458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.254682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.255110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.255410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.255612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.255777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.255930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.256091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.256282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.256436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.256682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.256851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.257011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.257173 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.257413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.257681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.257855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258758 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.258919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.259842 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260679 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.260846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.261954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.262212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.262370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.262531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.262696 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.262856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263575 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.263993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.264245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.264412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.264828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.264990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.265304 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.265566 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.265725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.265886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.266049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.266210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.266446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.266601 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.266869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.267027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.267181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.268296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.268460 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.268616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.268771 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.268945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269421 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.269908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.270061 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.270233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.270387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.271102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.271283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.271477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.271643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.271848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.272044 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.272611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.272794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.272951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.273111 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.273264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.273429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.273610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.273879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.274125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.274290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.274444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.274605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.274768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.275156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.275497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.275497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.275941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.276115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.276300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.276300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.276600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.276759 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.277833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.278977 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.279899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280589 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.280947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281075 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281432 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281545 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.281898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282147 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.282999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283227 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283596 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283875 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.283964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284188 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.284856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285533 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.285943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.286874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287418 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287504 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.287919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.288998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289093 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289168 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.289877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290017 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.290911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291096 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291452 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.291877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.292954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293049 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293194 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293419 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.293950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294327 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294876 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.294968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.295935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.296022 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.296131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.302761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.302933 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.303984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304699 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.304935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305204 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305564 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305564 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.305927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306397 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306835 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.306997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307545 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.307994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.308984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309063 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309386 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.309983 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310218 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310442 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.310999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311172 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.311853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312088 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312421 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.312857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313247 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.313978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314214 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.314984 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315656 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315900 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.315973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316180 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316277 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316822 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.316912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.317058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.317142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.317222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.317295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.317295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318286 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.318919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.319953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320261 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320634 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.320844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321100 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.321905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322259 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.322989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323078 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.323994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324235 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.324947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325259 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.325902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326217 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326445 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.326917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.327888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.328886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.329873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330232 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.330773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.331994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.332241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.332459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.332600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.332722 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.332848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.333973 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.334867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.335947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.336891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.337909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.338109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.338203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.338417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.338513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.338726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.339451 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.339548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.339626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.339626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.339792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.340073 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.340412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.340724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.341064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.341403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.341723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.342050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.342186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.342423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.342556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.342898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.343220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.343545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.343945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.344952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.345901 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346320 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346840 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.346943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.347887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.348985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.349930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.350889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.351841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.352062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.352180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.352398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.352503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.352717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353512 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.353917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354584 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354695 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.354912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355562 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355656 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.355983 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.356243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.356351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.356566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.356821 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.356928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.357106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:55:32.357202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.357479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.357806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.358131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.358458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.358789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.359119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.359437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.359757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.360078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.360459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.360793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.361133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.361482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.361810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.362136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.362460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.362784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.363301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.363636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.363954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.364873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.365201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.365552 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.366008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.366335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.366662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.366987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.367315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.367634 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.367956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.368319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.368663 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.369017 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.369349 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.369672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.370019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.370322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.370921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.371251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.371600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.371940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.372308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.372642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.372977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.373699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.374038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.374189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.374406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.374730 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.375047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.375381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.375704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.376019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.376381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.376700 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.377303 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.377668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.377998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.378336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.378670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.379003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.379319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.379656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.380033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.381008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.381349 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.381667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.381983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.382296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.382621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.382943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.383285 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.383604 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.383917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.384282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.384598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.384912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.385225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.385546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.385864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.386180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.386493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.386804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.387124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.387436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.387759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.388073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.388425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.388737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.389057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.389467 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.389763 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.390078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.390390 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.390718 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.391037 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.391367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.391689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.392010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.392402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.392728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.393432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.393674 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.394006 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.394362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.394702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.395016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.395329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.396137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.396571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.396900 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.397224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.397548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.397872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.398193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.398513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.398835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.399160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.399478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.399797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.400158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.400454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.400770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.401097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.401464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.401798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.402128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.402455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.402781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.403100 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.403419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.403736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.404056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.404409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.404754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.405074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.405386 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.405831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.406155 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.406487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.406817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.407136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.407467 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.407796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.408150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.408468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.408788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.409133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.409484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.409823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.410155 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.410469 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.410782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.411639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.412202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.412615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.412914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.413235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.413548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.413989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.414195 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.414578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.414808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.415120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.415436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.415747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.416060 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.416400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.416733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.417015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.417327 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.417644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.417959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.419883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.420220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.420551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.420874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.421204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.421520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.421851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.422182 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.422510 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.422826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.423165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.423481 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.423815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.424155 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.424466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.424782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.425201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.425435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.425767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.426079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.426414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.426945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.427299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.427593 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.427914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.428279 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.428599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.428923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.429240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.430072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.430072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.430072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.430569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.430803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.431129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.431452 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.431814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.432150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.432472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.432806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.433139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.433502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.433825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.434202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.434518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.434841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.435165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.435486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:55:32.435728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:55:32.743847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Registered counter for database nova_api Jul 14 15:55:32.743847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.743847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.744752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Registered counter for database nova_api Jul 14 15:55:32.744858 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.context [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cffebae-9f8f-471d-8503-434362f780eb(cell1) {{(pid=125267) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:55:32.744942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.745029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.745029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.745029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.745029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.745333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Registered counter for database nova_cell0 Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Registered counter for database nova_cell1 Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.745414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.745843 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.context [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cffebae-9f8f-471d-8503-434362f780eb(cell1) {{(pid=125266) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:55:32.745843 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.745843 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.745843 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.745843 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Registered counter for database nova_cell0 Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Registered counter for database nova_cell1 Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.746226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.806345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Registered counter for database nova_cell0 Jul 14 15:55:32.813110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.818280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:32.871862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Registered counter for database nova_cell0 Jul 14 15:55:32.878514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:55:32.883755 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:55:33.146112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:55:33.153606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:55:33.202695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:55:33.210314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:55:33.509903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:55:33.518336 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-9ca6f760-3ed0-4293-afa7-8a60d6ad41ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:55:33.525690 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a9e3149c0 pid: 125267 (default app) Jul 14 15:55:33.558941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:55:33.564959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-c53526f5-6e47-4bd2-a246-5e7b57d1fa3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:55:33.571887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a9e3149c0 pid: 125266 (default app) Jul 14 15:56:16.923864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.925802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.927806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.930129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.269000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de9d8f8c-8ae2-4da3-9e37-4ee1245c1745 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Action: 'create', calling method: .version_select at 0x7f0dc3dc4c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254699679", "metadata": {"Type": "work"}}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de9d8f8c-8ae2-4da3-9e37-4ee1245c1745 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 121 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:56:18.291406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254699679", "metadata": {"Type": "work"}}} Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: Jul 14 15:56:18.292864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-254699679', 'metadata': {'Type': 'work'}}}} Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:18.294004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:56:18.295340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:56:18.297703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:56:18.297703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.297703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de9d8f8c-8ae2-4da3-9e37-4ee1245c1745 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:18.297703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-de9d8f8c-8ae2-4da3-9e37-4ee1245c1745 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.385301 Jul 14 15:56:18.297703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1/1] 10.222.0.119 () {60 vars in 1160 bytes} [Thu Jul 14 15:56:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1387 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:56:18.571148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a821c9c-8560-4f5e-ad72-a3287a444f5c tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Action: 'create', calling method: .version_select at 0x7f0dc3e0a550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269652248", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a821c9c-8560-4f5e-ad72-a3287a444f5c tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 120 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:56:18.575934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269652248", "metadata": {"Type": "work"}}} Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 15:56:18.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1269652248', 'metadata': {'Type': 'work'}}}} Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi '0' Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:18.578207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:56:18.579638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:56:18.583472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:56:18.583472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.583472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a821c9c-8560-4f5e-ad72-a3287a444f5c tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:18.583472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a821c9c-8560-4f5e-ad72-a3287a444f5c tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.281638 Jul 14 15:56:18.584026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1/2] 10.222.0.119 () {60 vars in 1160 bytes} [Thu Jul 14 15:56:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:56:18.594133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0cbec11-bfc1-45b3-875d-08fced8b7e41 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Action: 'create', calling method: .version_select at 0x7f0dc3d17ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1278392854", "metadata": {"Type": "work"}}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0cbec11-bfc1-45b3-875d-08fced8b7e41 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 119 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:56:18.597015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1278392854", "metadata": {"Type": "work"}}} Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: Jul 14 15:56:18.598633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1278392854', 'metadata': {'Type': 'work'}}}} Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi '' Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:18.599766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:56:18.601388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:56:18.602777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:56:18.602777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:18.602777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0cbec11-bfc1-45b3-875d-08fced8b7e41 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:18.602777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0cbec11-bfc1-45b3-875d-08fced8b7e41 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008473 Jul 14 15:56:18.604012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 2/3] 10.222.0.119 () {60 vars in 1160 bytes} [Thu Jul 14 15:56:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:56:18.607990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.607990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.608611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.609897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.622870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21422e09-b161-4f87-b81e-543b169f98de tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Calling method '.version_select at 0x7f0dc3e0a5e0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:19.899163 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-21422e09-b161-4f87-b81e-543b169f98de tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] HTTP exception thrown: Volume tempest-invalid-1083501999 could not be found. Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21422e09-b161-4f87-b81e-543b169f98de tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1083501999 HTTP/1.1 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:56:19.903001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Volume tempest-invalid-1083501999 could not be found. Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'tempest-invalid-1083501999'} Jul 14 15:56:19.904359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1083501999 could not be found. (HTTP 404) (Request-ID: req-2664a1df-18ad-4dbf-b43f-b72aa7504864) Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:19.905083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:56:19.906132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1083501999 could not be found. Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:19.907153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1083501999 could not be found. Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1083501999 could not be found. Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21422e09-b161-4f87-b81e-543b169f98de tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 404 to user: Volume tempest-invalid-1083501999 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:19.908686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21422e09-b161-4f87-b81e-543b169f98de tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1083501999" status: 404 len: 99 microversion: 2.1 time: 1.299443 Jul 14 15:56:19.909523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 2/4] 10.222.0.119 () {58 vars in 1222 bytes} [Thu Jul 14 15:56:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1083501999 => generated 99 bytes in 1305 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:56:19.915468 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-84d2dd30-c83d-4f79-8b2c-fb559b7cdc62 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004675 Jul 14 15:56:19.916484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 3/5] 10.222.0.119 () {58 vars in 1144 bytes} [Thu Jul 14 15:56:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 15:56:19.930398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7a383128-f7dc-45ce-a432-ef9199243587 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008914 Jul 14 15:56:19.934668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 3/6] 10.222.0.119 () {58 vars in 1141 bytes} [Thu Jul 14 15:56:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 15:56:19.950381 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3774177f-38a0-493f-86cf-85fb9fc469da tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Calling method '.version_select at 0x7f0dc3dc4550>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:20.522678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-3774177f-38a0-493f-86cf-85fb9fc469da tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] HTTP exception thrown: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3774177f-38a0-493f-86cf-85fb9fc469da tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/os-volumes/d4b7dfff-152a-4f0d-b496-a2d0f45dd05a HTTP/1.1 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:56:20.527398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'd4b7dfff-152a-4f0d-b496-a2d0f45dd05a'} Jul 14 15:56:20.528509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. (HTTP 404) (Request-ID: req-b9733837-84fc-4813-8985-c43bf9268461) Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.529140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:56:20.529961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 15:56:20.530791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3774177f-38a0-493f-86cf-85fb9fc469da tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 404 to user: Volume d4b7dfff-152a-4f0d-b496-a2d0f45dd05a could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3774177f-38a0-493f-86cf-85fb9fc469da tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/d4b7dfff-152a-4f0d-b496-a2d0f45dd05a" status: 404 len: 109 microversion: 2.1 time: 0.582776 Jul 14 15:56:20.531635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 4/7] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 15:56:19 2022] DELETE /compute/v2.1/os-volumes/d4b7dfff-152a-4f0d-b496-a2d0f45dd05a => generated 109 bytes in 584 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:20.540355 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d8d113b-2098-4376-8285-fce065923a08 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Calling method '.version_select at 0x7f0dc466fee0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:20.928171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-7d8d113b-2098-4376-8285-fce065923a08 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] HTTP exception thrown: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d8d113b-2098-4376-8285-fce065923a08 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Request method failure captured: Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-volumes/f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d HTTP/1.1 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyggUWM1Fv0PHa398n-QhceXQNTf3d2UX_SRPqratLyWvjbmod3gRLDOObQZswGJjAYw9vY_PCo-WD9bi2yIm0c1HpMAWnPPGCdrKfpx959kXzENQCNcqp_TxZ6OhtQDtnGCw5jq_FyvoHxXImbSqtk0wvZqqBPezt-stPdc8DsElE Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:56:20.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7335838eb58d4485a4cb7676cca8ebf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7335838eb58d4485a4cb7676cca8ebf5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7335838eb58d4485a4cb7676cca8ebf5"}]}] Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 7335838eb58d4485a4cb7676cca8ebf5 Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-1331295639 Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 83bab4a7051c4c5a9f85e45af977e6f9 Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-1331295639-project Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d'} Jul 14 15:56:20.933151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. (HTTP 404) (Request-ID: req-7e569711-2edd-4769-856a-9d92f73e280d) Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.933911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:56:20.935003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:56:20.936043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. Jul 14 15:56:20.937227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:56:20.939243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d8d113b-2098-4376-8285-fce065923a08 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] Returning 404 to user: Volume f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:20.940290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d8d113b-2098-4376-8285-fce065923a08 tempest-VolumesNegativeTest-1331295639 tempest-VolumesNegativeTest-1331295639-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d" status: 404 len: 109 microversion: 2.1 time: 0.404860 Jul 14 15:56:20.952226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 4/8] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 15:56:20 2022] GET /compute/v2.1/os-volumes/f0ad0c1e-28e2-4cd0-bf04-f39f35a2271d => generated 109 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:32.002174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1153879282", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "networks": [{"uuid": "087db78d-bdc1-4063-aecb-2601edc6986a"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:32.290253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15fe2577-382f-440e-9a83-f60b5147a1cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: .version_select at 0x7f0dc3c4ac10>, body: {"keypair": {"name": "tempest-keypair-1269085348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEblA9sgyKA3rN7pV0l7zUbrISXEYZPhYimKMlKmV5OpBmSIwT0KbzlcwXroYYOMgKbrq7Zmmwz1soq7GEnrGsl13447m9iF0pOktm5feYSsUw2YttGkCtPI9DFcUxyssw=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:32.313189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] validate_networks() for [('087db78d-bdc1-4063-aecb-2601edc6986a', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:32.408999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-15fe2577-382f-440e-9a83-f60b5147a1cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:32.434747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-15fe2577-382f-440e-9a83-f60b5147a1cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:32.667871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15fe2577-382f-440e-9a83-f60b5147a1cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.102107 Jul 14 15:56:32.673931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 5/9] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 15:56:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:33.698274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1298734065", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:33.918014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] validate_networks() for [('f2a008ce-b413-4a5d-9bd5-9c77d32d3f2c', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:35.456198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:35.456198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:35.457729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:35.457729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:35.457729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:35.490653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:35.490653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.490653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:35.490653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.577974 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Getting quotas for project 337009c5341c4de4a64823371566766c. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:35.593913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Getting quotas for user 9d152595f433420f9cd0b7d45a4cb6da and project 337009c5341c4de4a64823371566766c. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:35.629368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:35.638211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:35.925173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17064768-0d7e-4eef-8a64-e678b286df57 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.522718 Jul 14 15:56:35.925907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 5/10] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:56:31 2022] POST /compute/v2.1/servers => generated 382 bytes in 4527 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:56:36.428418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:36.428898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:36.429333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:36.430014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:36.430495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:36.462095 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.462663 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.464225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.467535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.528309 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a93579e-fb7f-4350-be42-51c8dbbe2874 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: .version_select at 0x7f0dc3b219d0>, body: {"keypair": {"name": "tempest-keypair-722192581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcCa/hIg3FGtejqHfYqg31hRD4owFajgQD53Qt1wmglEze+v5FVvMpHyrt1cBPKpsoLiA4/ZZZglFAtKpEZFR74V2IFiFrVAla/dWIy4QeljQ6kC/QuuWmotPnBeVXqfw=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:36.554734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:36.559551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8a93579e-fb7f-4350-be42-51c8dbbe2874 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:36.561200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for user fe6f58bedd87454bad46b0c48697eec9 and project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:36.564435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8a93579e-fb7f-4350-be42-51c8dbbe2874 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for user 6bbbf243c1334013ac235aa5b0853621 and project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:36.587982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:36.601883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:36.724417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a93579e-fb7f-4350-be42-51c8dbbe2874 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.789713 Jul 14 15:56:36.725031 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 6/11] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 15:56:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:36.729838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b4b499f-22df-43cb-8c50-e5dc28e97656 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:36.730643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b4b499f-22df-43cb-8c50-e5dc28e97656 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:36.820876 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6dc336b-fe1a-4329-bb94-292445149608 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.150126 Jul 14 15:56:36.821912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 6/12] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:56:32 2022] POST /compute/v2.1/servers => generated 385 bytes in 4152 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:56:36.839608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f999c57-cd57-4008-9aa8-fe4d6484b989 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:36.841916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f999c57-cd57-4008-9aa8-fe4d6484b989 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:36.842950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6b4b499f-22df-43cb-8c50-e5dc28e97656 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:36.858735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b4b499f-22df-43cb-8c50-e5dc28e97656 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1219 microversion: 2.1 time: 0.132477 Jul 14 15:56:36.869082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 7/13] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:36 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:37.064216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f999c57-cd57-4008-9aa8-fe4d6484b989 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:37.098495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f999c57-cd57-4008-9aa8-fe4d6484b989 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1226 microversion: 2.1 time: 0.265003 Jul 14 15:56:37.099489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 7/14] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:36 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:37.562183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1327630091", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:37.698402 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] validate_networks() for [('f2a008ce-b413-4a5d-9bd5-9c77d32d3f2c', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:37.877419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b2390773-ddda-46b6-9ea6-afd54694f00e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:37.878158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b2390773-ddda-46b6-9ea6-afd54694f00e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:38.297728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2390773-ddda-46b6-9ea6-afd54694f00e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:38.308885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b2390773-ddda-46b6-9ea6-afd54694f00e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1219 microversion: 2.1 time: 0.436157 Jul 14 15:56:38.315536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 8/15] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:37 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1219 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:38.346468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-209774383", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81beb021-9d5c-47cd-b940-d1c5b4031ad6"}], "security_groups": [{"name": "tempest-securitygroup--1272201068"}], "key_name": "tempest-keypair-1269085348", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:38.718729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] validate_networks() for [('81beb021-9d5c-47cd-b940-d1c5b4031ad6', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:39.470186 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:39.470690 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:39.471140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:39.471579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:39.472077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:39.487930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.491464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.493649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.494293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.543363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:39.867225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for user fe6f58bedd87454bad46b0c48697eec9 and project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:39.867225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:39.867225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:39.870840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:39.870840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:39.870840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:39.870840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:39.870840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:39.873014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.873014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.873014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.873014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.873656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:39.873656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:39.873656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:39.873656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:40.025952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff88a3a9-53bc-4192-aa54-cd7c28bbba2f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.469448 Jul 14 15:56:40.026626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 8/16] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:56:37 2022] POST /compute/v2.1/servers => generated 385 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:56:40.034323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-36a46ea2-c2f4-40d2-bc0f-71ef9c7329ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:40.035175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-36a46ea2-c2f4-40d2-bc0f-71ef9c7329ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:40.120509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8994f411-6bf6-4481-81ed-1340c7ff04e8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.797589 Jul 14 15:56:40.120509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 9/17] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:56:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:56:40.135578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab748530-de63-4365-886b-ef2315209f4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:40.135578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab748530-de63-4365-886b-ef2315209f4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:40.210591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36a46ea2-c2f4-40d2-bc0f-71ef9c7329ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:40.218516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-36a46ea2-c2f4-40d2-bc0f-71ef9c7329ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1219 microversion: 2.1 time: 0.190618 Jul 14 15:56:40.219088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 9/18] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:40 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:40.242203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b6ab90e-593f-4e96-89b8-6c3a90a76eff tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:40.242890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b6ab90e-593f-4e96-89b8-6c3a90a76eff tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:40.363982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ab748530-de63-4365-886b-ef2315209f4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:40.375056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab748530-de63-4365-886b-ef2315209f4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1226 microversion: 2.1 time: 0.255643 Jul 14 15:56:40.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 10/19] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:40 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1226 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:40.496088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b6ab90e-593f-4e96-89b8-6c3a90a76eff tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:40.521219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b6ab90e-593f-4e96-89b8-6c3a90a76eff tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1245 microversion: 2.1 time: 0.290076 Jul 14 15:56:40.523039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 10/20] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:40 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1245 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:41.236551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:41.237256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:41.258742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:41.259237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:41.262221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:41.270144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:41.396025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d4c54d2-f95f-49f7-a707-dd6cb6018006 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:41.397799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d4c54d2-f95f-49f7-a707-dd6cb6018006 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:41.463903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:41.479019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f27ccb2b-6f87-4c55-a607-c14c36c353cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1223 microversion: 2.1 time: 0.247878 Jul 14 15:56:41.491315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 11/21] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:41 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1223 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:41.515011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2d4c54d2-f95f-49f7-a707-dd6cb6018006 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:41.523451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d4c54d2-f95f-49f7-a707-dd6cb6018006 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1226 microversion: 2.1 time: 0.135127 Jul 14 15:56:41.524417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 11/22] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:41 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:41.540423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c961f03f-0969-431e-8aa0-56ea6a7acadb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:41.543795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c961f03f-0969-431e-8aa0-56ea6a7acadb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:41.626142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c961f03f-0969-431e-8aa0-56ea6a7acadb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:41.634588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c961f03f-0969-431e-8aa0-56ea6a7acadb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1245 microversion: 2.1 time: 0.098793 Jul 14 15:56:41.636651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 12/23] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:41 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:42.216187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1867500558", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0db5c9e0-6015-46b4-9562-0020fed485ab"}], "security_groups": [{"name": "tempest-securitygroup--1588508134"}], "key_name": "tempest-keypair-722192581", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:42.323698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] validate_networks() for [('0db5c9e0-6015-46b4-9562-0020fed485ab', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:42.502986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:42.504476 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:42.528422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.529633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.530902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.531549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.616726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:42.625078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dd820440-dd6c-4907-abc4-d8927f5fafdd tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1223 microversion: 2.1 time: 0.129277 Jul 14 15:56:42.625884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 13/24] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:42 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:42.637758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:42.638638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:42.645659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.647165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.656155 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.656631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.738630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:42.753381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-de9a8d2d-d5b9-4965-a09f-20f9884870ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1230 microversion: 2.1 time: 0.126469 Jul 14 15:56:42.754368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 14/25] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:42 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1230 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:42.770650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:42.772162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:42.780526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.783304 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.784473 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.784930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.884934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:42.892502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dd9d60a1-fb20-43f9-abc7-cf739877e098 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1249 microversion: 2.1 time: 0.127492 Jul 14 15:56:42.893070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 15/26] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:42 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:42.908626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:42.909206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:42.909688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:42.910112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:42.910527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:42.919985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.920495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.921306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:42.921794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.939717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:42.943557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for user 6bbbf243c1334013ac235aa5b0853621 and project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:42.954697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:42.957234 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:43.161288 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3fc41645-0011-450f-b870-8a9405627424 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.950355 Jul 14 15:56:43.162068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 12/27] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:56:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:56:43.172536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f3f38d0-78b9-48c8-beb2-081c23e2d222 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:43.173165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f3f38d0-78b9-48c8-beb2-081c23e2d222 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:43.248878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f3f38d0-78b9-48c8-beb2-081c23e2d222 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:43.257007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f3f38d0-78b9-48c8-beb2-081c23e2d222 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1241 microversion: 2.1 time: 0.088482 Jul 14 15:56:43.257777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 16/28] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:43 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:43.642733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:43.643603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:43.652000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.652500 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.653349 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.653802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.782100 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:43.783805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:43.792005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.792795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.793942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.794584 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.813846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:43.826368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f650e4a5-f824-48c8-b8d4-a9e63e788bcc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1223 microversion: 2.1 time: 0.187578 Jul 14 15:56:43.836440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 13/29] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:43 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:43.871100 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:43.900592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-994173e3-badd-4703-bef2-3ba734814179 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1230 microversion: 2.1 time: 0.126841 Jul 14 15:56:43.902049 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 17/30] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:43 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:43.909220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:43.909929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:43.920562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.921251 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.922231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.922911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.990937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:43.998859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9e009bb2-80f7-47ed-822f-15a88a20516b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1249 microversion: 2.1 time: 0.093047 Jul 14 15:56:43.999072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 14/31] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:43 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:44.275101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-07748421-d7e1-4b8a-a3f9-72496effb21e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:44.275738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-07748421-d7e1-4b8a-a3f9-72496effb21e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:44.346271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-07748421-d7e1-4b8a-a3f9-72496effb21e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:44.356636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-07748421-d7e1-4b8a-a3f9-72496effb21e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1241 microversion: 2.1 time: 0.083635 Jul 14 15:56:44.357493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 18/32] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:44 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:44.842983 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:44.843712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:44.850688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.851435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.852486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.853070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.918096 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:44.918918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:44.922298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:44.925651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.926215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.926870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.928018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.932366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57efb902-3d19-495c-bfca-6f7ec1352836 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1223 microversion: 2.1 time: 0.093344 Jul 14 15:56:44.932953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 15/33] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:44 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:44.994322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:45.001928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2adc6e88-dac7-480c-a8f3-84c4c6f5e69a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1230 microversion: 2.1 time: 0.087867 Jul 14 15:56:45.002479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 19/34] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:44 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:45.016266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:45.016922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:45.022960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.023619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.024438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.024879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.088732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:45.097388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9db47738-e67a-4225-9ead-b73c27252567 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1249 microversion: 2.1 time: 0.084807 Jul 14 15:56:45.097924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 16/35] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:45 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:45.374848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:45.375388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:45.381909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.382376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.383165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.383612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.464690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:45.472391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d9470aa-e228-41ea-a9fb-9a12f6981df7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1245 microversion: 2.1 time: 0.101515 Jul 14 15:56:45.473477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 20/36] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:45 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:45.951589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:45.956223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:45.979067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.979521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.982843 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.982843 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.019328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:46.020705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:46.034090 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.034555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.035352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.035826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.062179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:46.080020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2886cf5e-b89e-4cbf-b787-d6a198e17d10 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1223 microversion: 2.1 time: 0.133820 Jul 14 15:56:46.081239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 17/37] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:45 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:46.116572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:46.117354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:46.124401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.125176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.126215 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.127071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.178639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:46.188031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a66e0368-1a3f-4e4d-8340-420ce8e224bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1230 microversion: 2.1 time: 0.172005 Jul 14 15:56:46.189021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 21/38] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:46 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1230 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:46.225846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:46.234734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d041e36e-5c6f-4a3a-8424-2fcc5fe43fbb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1249 microversion: 2.1 time: 0.123573 Jul 14 15:56:46.235481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 18/39] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:46 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1249 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:46.491455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:46.492411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:46.499313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.500847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.503819 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.521503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.604311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:46.612475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-57a9baff-2ff0-49d7-8e0c-fbaba6253927 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1237 microversion: 2.1 time: 0.125964 Jul 14 15:56:46.613141 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 22/40] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:46 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:47.098445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:47.100596 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:47.107817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.108972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.110111 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.110768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.202023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:47.205523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:47.207651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:47.212761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b41302e-3b35-4d37-8e97-958fae59ed6e tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1271 microversion: 2.1 time: 0.118464 Jul 14 15:56:47.213988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 19/41] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:47 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:47.224154 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.227510 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.228372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.228829 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.258898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:47.259888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:47.266680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.267343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.268139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.268579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.299759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:47.308174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49fe72eb-afc9-4723-bf54-e99124a60628 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1278 microversion: 2.1 time: 0.106885 Jul 14 15:56:47.308748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 23/42] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:47 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:47.334684 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:47.342406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f1aeac42-3e49-4ad9-9f41-cb29dcba183a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1297 microversion: 2.1 time: 0.093307 Jul 14 15:56:47.343517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 20/43] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:47 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:47.631245 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:47.631989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:47.638047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.638506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.639278 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:47.639756 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:47.702670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:47.711517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-111d60e2-cc1d-4e53-9cec-205b14a51726 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1293 microversion: 2.1 time: 0.084550 Jul 14 15:56:47.712183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 24/44] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:47 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:48.230291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:48.230968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:48.237392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.237782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.238562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.239008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.326706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:48.327890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:48.337125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.337125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.337549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.337861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.353493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:48.364388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7a64a2a8-42df-49d2-b48d-f814d25357b8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1271 microversion: 2.1 time: 0.137891 Jul 14 15:56:48.373969 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 21/45] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:48 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:48.373969 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:48.373969 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:48.379519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.380785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.382003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.382605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.411230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:48.419356 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-143d49e0-c137-4479-a9ea-93a852378687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1278 microversion: 2.1 time: 0.096244 Jul 14 15:56:48.428190 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 25/46] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:48 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:48.459866 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:48.464307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53949542-6d33-4912-a360-0111cf0fc094 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1297 microversion: 2.1 time: 0.098249 Jul 14 15:56:48.465122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 22/47] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:48 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:48.729253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:48.729866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:48.735870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.736564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.737334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.737780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.819019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:48.829213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-419dad6a-ebd9-4007-a24b-930099d43e73 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1293 microversion: 2.1 time: 0.103779 Jul 14 15:56:48.830011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 26/48] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:48 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:49.384694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:49.386167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:49.394103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:49.399617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.401287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.402400 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.402988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.438692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:49.439853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:49.465474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.466517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.466903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.471763 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.659084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:49.674321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6008fa5d-382f-4906-b469-66193448890f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1289 microversion: 2.1 time: 0.296628 Jul 14 15:56:49.675285 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 23/49] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:49 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1289 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:49.681795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:49.682589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:49.701961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.703171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.704392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.706051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.711612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:49.719614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5842344f-5c2c-4987-8caa-14177f09d2fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1284 microversion: 2.1 time: 0.285666 Jul 14 15:56:49.729555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 27/50] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:49 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:49.846960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:49.847581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:49.849690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:49.851706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:49.867526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.868839 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.875798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.878166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.110534 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:50.115517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:50.124774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7dc7452-c6a1-46e7-96d9-f6e4c66f2afd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1311 microversion: 2.1 time: 0.281495 Jul 14 15:56:50.124978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb960245-6c9b-40a2-bb65-877b32e7d1d6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1303 microversion: 2.1 time: 0.448385 Jul 14 15:56:50.125694 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 28/51] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:49 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:50.176251 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 24/52] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:49 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1303 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:50.691739 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:50.694977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:50.704678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.707761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.707761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.708387 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.745469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:50.746118 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:50.772982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.789991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.791527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.792673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.795795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:50.799542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:50.804040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c61dc90b-39d7-4463-84e5-787897356641 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1277 microversion: 2.1 time: 0.116725 Jul 14 15:56:50.804620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 29/53] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:50 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:51.151657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:51.152403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:51.167926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.168410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.169193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.169628 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.185267 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:51.205260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-86545489-cc41-4ef9-be85-8df88ffbab94 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.470996 Jul 14 15:56:51.221632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 25/54] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:50 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:51.250612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:51.254317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:51.263829 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.273473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.274315 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.275202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.303257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:51.311898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c325ef5-6095-460d-b2fc-ba61ba3397d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1299 microversion: 2.1 time: 0.163959 Jul 14 15:56:51.312768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 30/55] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:51 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:51.473855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:51.484450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ee45811-3517-474a-a929-ee96258c040a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.261222 Jul 14 15:56:51.485725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 26/56] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:51 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:51.821898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:51.822535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:51.832749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.833209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.834514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.835114 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.998727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:52.005116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f5539e1c-9c98-4ade-9652-1dd35a8187c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.187802 Jul 14 15:56:52.006334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 31/57] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:51 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:52.228681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:52.229300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:52.235575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.236030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.236828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.237269 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.333987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:52.336750 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:52.340999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.341446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.342511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.342944 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.373492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:52.382764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-defd6d1a-48bf-46ba-be0a-816cf90873bd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.158725 Jul 14 15:56:52.384174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 27/58] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:52 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:52.474988 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:52.483134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a15bdf2-50af-4548-8dab-46c8f837f710 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.154727 Jul 14 15:56:52.483760 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 32/59] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:52 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:52.504810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:52.506801 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:52.520428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.521115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.522069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.522761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.545688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:52.673723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:52.684818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c0b57a1-b263-4bf5-b8ff-942fb81a6e2f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.182408 Jul 14 15:56:52.695773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 28/60] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:52 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:53.026020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:53.029362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:53.033946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.034611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.035558 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.035998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.198319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:53.205887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f7b63148-3dd0-470e-a299-5d05073048e1 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.184941 Jul 14 15:56:53.206457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 33/61] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:53 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:53.400117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:53.400729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:53.402509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:53.403282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=30 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:53.408382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.408834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.409607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.410075 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.503812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:53.504535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:53.512021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.512593 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.513609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.514114 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.551785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:53.559456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cabf14dc-58ca-4170-b4bd-a5ce9025e59c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.163657 Jul 14 15:56:53.564818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 29/62] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:53 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:53.650491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:53.657937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42293ef5-f64c-48b1-a176-85b4773acec5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.158181 Jul 14 15:56:53.658492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 34/63] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:53 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:53.702051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:53.702668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:53.709806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.711645 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.711645 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.711645 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.847414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:53.847414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd59a8b6-f6a5-4d47-8706-ccddce00316f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.148632 Jul 14 15:56:53.847414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 30/64] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:53 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:54.222626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:54.223281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:54.230009 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.230464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.231239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.231677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.350709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:54.395251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:54.403729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-94aa156b-d731-4561-a6f9-b2a6bea5bda3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.184850 Jul 14 15:56:54.404401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 35/65] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:54 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:54.577560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:54.582912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:54.585068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.585538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.586295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.586750 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.675035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:54.675652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:54.682341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.684605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.684605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.684605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.717597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:54.725632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f04177d6-29b3-4692-b5b8-1bc50ad372bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.151839 Jul 14 15:56:54.726208 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 31/66] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:54 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:54.815362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:54.824022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-db5105a3-00df-4a55-8868-42c6f0fb59ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.152852 Jul 14 15:56:54.824615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 36/67] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:54 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:54.869040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:54.869040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:54.878822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.879361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.880253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.880845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.020202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:55.028850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a982a4c2-3fba-4d45-8a93-c3e1e10d027b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.165870 Jul 14 15:56:55.029472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 32/68] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:54 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:55.422397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.423200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.430911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.431765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.432935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.433607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.595825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:55.600888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0f511b36-a775-479d-842b-f5af64591cf2 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.182890 Jul 14 15:56:55.611189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 37/69] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:55.743381 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.744120 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.750144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.750598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.751404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.751842 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.843524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.844454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.853520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.854055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.855104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.855613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.926904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:55.935357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2eed8885-0622-4633-b2e9-7ca01ca13c96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.196377 Jul 14 15:56:55.951989 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 33/70] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.027461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:56.035262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69947082-0677-4a1a-959b-9a7ce4f4c54b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.196082 Jul 14 15:56:56.035817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 38/71] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.046713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:56.047321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.053976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.054427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.055231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.055662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.189624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:56.197389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85fef612-c4f2-483f-842a-4cd5ba215c53 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.154583 Jul 14 15:56:56.197952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 34/72] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:56 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.625124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:56.657582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.657582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.657582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.657582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.658393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.926567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:56.934908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-09a192e9-f2d2-4c7b-8c46-97c60b01c5c8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.313542 Jul 14 15:56:56.935488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 39/73] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:56 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.965579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:56.966275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.972415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.974593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.974593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.974593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.053089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:57.054112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:57.060561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.061023 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.061990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.062382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.151929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:57.169658 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd6f1ea6-c440-4a69-be9c-044a6f955c57 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.207777 Jul 14 15:56:57.170940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 35/74] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:56 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:57.214707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:57.215315 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:57.222559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.223129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.223783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.224284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.229714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:57.245918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf0e66ff-e3f2-4e38-8ea3-f89470396d42 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.196633 Jul 14 15:56:57.246909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 40/75] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:57 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:57.404249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:57.414414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c805528-3743-40b7-89ec-82d7d7e93b3b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.203460 Jul 14 15:56:57.415737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 36/76] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:57 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:57.952147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:57.952770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:57.960021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.960521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.961288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.961721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.148379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.155803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a782ded9-423c-41e1-9b66-e4287e58ada6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.207678 Jul 14 15:56:58.156410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 41/77] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:57 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:58.186884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:58.187702 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:58.194728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.195172 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.196186 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.196621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.265671 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:58.266686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:58.277390 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.277841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.278625 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.279081 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.447726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.469102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-abdc9932-a275-415d-bc58-05a7e084d76b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.285224 Jul 14 15:56:58.476813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 37/78] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:58 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:58.498133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:58.507239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:58.554797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.556206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.558199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:58.559227 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.574066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.593996 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e08c23f-3428-4ccc-b3d6-af84af95cb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.334436 Jul 14 15:56:58.594952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 42/79] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:58 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:58.780028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.798599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d661300b-70c1-40a6-a171-3e688fe750c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.319400 Jul 14 15:56:58.799502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 38/80] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:58 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.173914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.174571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.181373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.181827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.182729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.183162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.320345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.327958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65072549-135c-4ded-b359-e04bb58e8fba tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.158279 Jul 14 15:56:59.328572 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 43/81] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.494164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.494980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.500954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.501416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.502220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.502659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.611591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.612560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.620343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.621616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.622613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.623711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.681355 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.689481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-43135358-d09e-4be8-8570-fe94f7d05d99 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.199802 Jul 14 15:56:59.690060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 39/82] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.793553 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.802839 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d362f231-3e7b-4f3e-80d6-29502a798c31 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.195053 Jul 14 15:56:59.804048 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 44/83] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.815982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.816625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.823823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.824528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.825473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.826047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.975241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.982954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b400e7a-6af6-48f1-a8e1-23887ce5150f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.170686 Jul 14 15:56:59.983666 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 40/84] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:00.353376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.354341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.363920 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.364975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.366031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.366461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.550350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:00.560796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b65c7df-c09c-47cb-b651-b49df1c9fe39 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.215819 Jul 14 15:57:00.562000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 45/85] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:00.707916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.709223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.716278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.717092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.718253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.719334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.821120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.821769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.837465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.840951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.840951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.840951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.872265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:00.908463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:00.918445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad5e5abf-b870-43d7-8ae6-28a1221c8bf0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.215455 Jul 14 15:57:00.919849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 41/86] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:01.002774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.003401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.018404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.019138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.020165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.020749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.039425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.047590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b2a6d1c-8321-4bbd-b2fd-e4e7824edf39 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.231200 Jul 14 15:57:01.057490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 46/87] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:01.219207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.227078 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-566a80a0-0fa4-4624-92e9-0aa767c5d1c0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.228228 Jul 14 15:57:01.227662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 42/88] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:01.578989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.580340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.587599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.588083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.588890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.589329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.732958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.741255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6857cc6-67b3-47db-a826-2b10dacac95d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.166567 Jul 14 15:57:01.741931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 47/89] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:01 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:01.948832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.949922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.961755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.962503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.963890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.964743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.066670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:02.068460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:02.082033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.082977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.084501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.085152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.166213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.174177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a6d9b01-9cd9-47c7-90cb-27eeec091374 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.233721 Jul 14 15:57:02.184605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 43/90] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:01 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:02.245189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:02.245418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.245805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:02.252029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.252514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.253279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.253370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc2e7f64-2513-4b01-9612-98c0f27e801a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.191962 Jul 14 15:57:02.253714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.253948 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 48/91] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:02 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:02.392886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.401726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e3b7847-3800-499c-81ba-b6a05fe793b8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.160202 Jul 14 15:57:02.402221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 44/92] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:02 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:02.758080 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:02.758690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:02.765054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.769204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.769204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.769204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.905365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.914159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9be57c65-e90e-4439-ae38-b8946e7141ce tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.159444 Jul 14 15:57:02.914258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 49/93] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:02 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.202210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.202210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.207482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.207939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.209556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.210045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.214065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:03.272354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.273423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.286083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.286885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.292994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.303650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.467230 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:03.486944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d535dbe3-daad-4974-8609-895b79fe0026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.280025 Jul 14 15:57:03.486944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 45/94] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.486944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.486944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.493022 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.493744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.494594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.495098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.519804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:03.532805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1012ec8d-6a94-4e4c-b270-90eb1f292a48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.264422 Jul 14 15:57:03.534774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 50/95] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.680563 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:03.688059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc654501-dc63-40ec-82e2-b9bb39640cd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.209858 Jul 14 15:57:03.688657 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 46/96] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.931436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.932123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.938658 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.939116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.939994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.940456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.072656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.079534 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-936b6481-64fd-4d39-af65-93b6c9a979a5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.152519 Jul 14 15:57:04.080134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 51/97] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:04.493423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.494098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.500566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.501070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.503322 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.503322 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.549972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.550742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.559069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.559598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.560623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.561439 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.713150 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.721951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d689ef4-a5f1-49e9-bfe8-028c60c18b70 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.232835 Jul 14 15:57:04.722935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 47/98] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:04.728174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.728952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.735986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.736656 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.737475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.737937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.789703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.800265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bdd9a352-c6b4-4743-aaea-a88f4e7851c3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.254255 Jul 14 15:57:04.801520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 52/99] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:04.919925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.929990 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cfe17b09-15a4-4e4a-9ca4-7027f5869e2b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.206008 Jul 14 15:57:04.930920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 48/100] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:05.098187 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.101668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.111787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.113143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.116201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.117197 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.598241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:05.614470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5dac2bc-2234-4dbb-8085-3cc51cab0395 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.521306 Jul 14 15:57:05.615529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 53/101] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:05.744083 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.745570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.759526 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.761969 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.770627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.776411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.824411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.829816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.847181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.862004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.868296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.868296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.114229 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.125862 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-98c67047-df3f-43ef-a951-686a8c4954d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.390779 Jul 14 15:57:06.133291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 49/102] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:06.141392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:06.142007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:06.157984 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.167508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.167508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.167508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.625016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.651537 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ed016133-504d-4885-b1c8-e05934ddc8b7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.836323 Jul 14 15:57:06.652156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 54/103] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:06.672541 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:06.692641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:06.703358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.704144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.705185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.705844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.868313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.886465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b5f0f0c9-feb9-4db0-a42d-ec024b050f71 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.748107 Jul 14 15:57:06.887428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 50/104] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:06 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.119317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:07.134213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-788c816e-b3e8-4533-ad83-338964890065 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.464516 Jul 14 15:57:07.134213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 55/105] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:06 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.148487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:07.149419 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:07.155742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.156271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.157044 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.157660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.464669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:07.478098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-df655617-0721-4b3c-a7b1-b465bbf8351e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.333168 Jul 14 15:57:07.489560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 51/106] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:07 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.671546 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:07.672212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:07.702343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.713756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.713756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.713756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.868554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-eacd3b9c-2c71-49ee-ad9a-d6a8972a4b96 req-25d477f8-992d-47f3-b060-1e447a557957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599bf41f-04fc-42f6-8c4c-5946659a0fee", "tag": "06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:07.902536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacd3b9c-2c71-49ee-ad9a-d6a8972a4b96 req-25d477f8-992d-47f3-b060-1e447a557957 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.903056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacd3b9c-2c71-49ee-ad9a-d6a8972a4b96 req-25d477f8-992d-47f3-b060-1e447a557957 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.982592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-eacd3b9c-2c71-49ee-ad9a-d6a8972a4b96 req-25d477f8-992d-47f3-b060-1e447a557957 service nova] Creating event network-changed:06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b for instance 599bf41f-04fc-42f6-8c4c-5946659a0fee on hv-cinder-84986 Jul 14 15:57:07.990392 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacd3b9c-2c71-49ee-ad9a-d6a8972a4b96 req-25d477f8-992d-47f3-b060-1e447a557957 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:57:08.001809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.005200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.006443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.007054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.017118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.compute.rpcapi [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:57:08.017940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=125266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:57:08.046097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-359dcbb5-f698-438a-a4a6-fc6d46a021b1 None None] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501255 Jul 14 15:57:08.047039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 56/107] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:08.055729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.058341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.071703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.072263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.073062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.073507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.460612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:08.470254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b70c00df-680a-47c4-aef8-cceae4fe2ed4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.803869 Jul 14 15:57:08.471000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 52/108] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:07 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:08.590431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-bc6d761e-15f4-48ea-adac-d1028f654f97 req-132efbe5-d72a-4dfa-bc9f-29bc3a44f6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d91ec6-f9a0-44a2-8b49-d337f3c3b36e", "tag": "3fcbf50b-887c-4db2-b9dc-4803059614b5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:08.603732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:08.613443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc3e5df0-314f-4c5d-b287-6bd06a0b311b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.565027 Jul 14 15:57:08.616549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-bc6d761e-15f4-48ea-adac-d1028f654f97 req-132efbe5-d72a-4dfa-bc9f-29bc3a44f6b6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.617141 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-bc6d761e-15f4-48ea-adac-d1028f654f97 req-132efbe5-d72a-4dfa-bc9f-29bc3a44f6b6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.624897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 57/109] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:08.635274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.638440 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.644323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-bc6d761e-15f4-48ea-adac-d1028f654f97 req-132efbe5-d72a-4dfa-bc9f-29bc3a44f6b6 service nova] Creating event network-changed:3fcbf50b-887c-4db2-b9dc-4803059614b5 for instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e on hv-cinder-84986 Jul 14 15:57:08.644866 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-bc6d761e-15f4-48ea-adac-d1028f654f97 req-132efbe5-d72a-4dfa-bc9f-29bc3a44f6b6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:57:08.646598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.651478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.653622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.654092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.663351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.664995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.664995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.665970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.689374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.compute.rpcapi [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:57:08.690544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] Releasing lock "compute-rpcapi-router" {{(pid=125267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:57:08.727631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f77908df-b4ee-4563-a953-fec8a933ba52 None None] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254766 Jul 14 15:57:08.729049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 53/110] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:08.735308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.736351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.744978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.745943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.746957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.747634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.278464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.288277 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a4c20df3-cf47-4661-8649-3737a0830998 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.661735 Jul 14 15:57:09.290815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 58/111] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:09.375833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.385712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-464e07e9-5d4b-4f4e-bfeb-cd8b88492026 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.655081 Jul 14 15:57:09.386403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 54/112] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:09.488026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:09.488695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:09.501057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.501513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.502653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.503099 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.633437 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:09.634212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:09.644062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.647377 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.648220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.648662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.776315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.784084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-519c7570-8e06-4328-9fb0-635e81f41bc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.300022 Jul 14 15:57:09.784691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 59/113] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:09 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:09.842427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.850494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f1db1ce5-d0cf-4a83-af43-b030a33725a8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.223174 Jul 14 15:57:09.851074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 55/114] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:09 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:10.149341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06201b79-aa1b-474d-8a40-6ef60e0498fd", "tag": "3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad"}, {"name": "network-changed", "server_uuid": "41756c6f-5714-4b75-b3fb-ee75edcac924", "tag": "fd63becb-ed28-4d91-8401-801a37b8d3fa"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:10.158174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.158625 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.171190 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] Creating event network-changed:3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad for instance 06201b79-aa1b-474d-8a40-6ef60e0498fd on hv-cinder-84986 Jul 14 15:57:10.171693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] Creating event network-changed:fd63becb-ed28-4d91-8401-801a37b8d3fa for instance 41756c6f-5714-4b75-b3fb-ee75edcac924 on hv-cinder-84986 Jul 14 15:57:10.178664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-aadad0d8-dfa9-4ee6-8cae-0b91aa6f0146 req-0a821a0a-4f85-464b-b643-2092e5af054e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032986 Jul 14 15:57:10.179232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 60/115] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:10.306599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.307200 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:10.313357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.313800 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.314553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.315112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.403524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.404257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:10.410754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.411235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.413157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.413606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.447335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.456265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-10219b11-da48-483b-9e4f-b643ecfae71b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.153484 Jul 14 15:57:10.457205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 56/116] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:10.558536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.566191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eac93da9-0564-4a90-9ca4-85eafbeb889a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.166954 Jul 14 15:57:10.566988 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 61/117] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:10.806132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-cda162d6-4fcf-46d7-b364-cab6d3a6970a req-3c8626ab-28f2-4f84-928c-e230a2d3ae20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9596a1-f8ec-4682-a980-392e550ebc33", "tag": "a289ebfe-7229-4303-8c8b-17ea1de7a70e"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:10.807873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.808710 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:10.820522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cda162d6-4fcf-46d7-b364-cab6d3a6970a req-3c8626ab-28f2-4f84-928c-e230a2d3ae20 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.820978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cda162d6-4fcf-46d7-b364-cab6d3a6970a req-3c8626ab-28f2-4f84-928c-e230a2d3ae20 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.821503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.822411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.823841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.824648 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.835752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-cda162d6-4fcf-46d7-b364-cab6d3a6970a req-3c8626ab-28f2-4f84-928c-e230a2d3ae20 service nova] Creating event network-changed:a289ebfe-7229-4303-8c8b-17ea1de7a70e for instance 5f9596a1-f8ec-4682-a980-392e550ebc33 on hv-cinder-84986 Jul 14 15:57:10.850976 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-cda162d6-4fcf-46d7-b364-cab6d3a6970a req-3c8626ab-28f2-4f84-928c-e230a2d3ae20 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 Jul 14 15:57:10.851775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 62/118] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:10.868391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.872754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:10.876612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.877059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.878053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.878688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.101101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.109867 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-751e603f-a488-4716-a1d2-888d3f501991 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.311210 Jul 14 15:57:11.110548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 57/119] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:11.127763 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.147940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fdb8a60-8b63-4dc9-ba13-517f42aa0361 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.284510 Jul 14 15:57:11.150532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 63/120] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:11.475666 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:11.476321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.482591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.483045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.483818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.484409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.593335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:11.593807 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.603012 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.603466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.604417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.604963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.633964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.641601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-019758a0-7f70-4df6-b646-1eb42b3f768a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.170650 Jul 14 15:57:11.644634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 58/121] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:11 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:11.735918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.739610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:11.746240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54adbda9-ae60-41ce-b828-19f5603811cc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.166615 Jul 14 15:57:11.746826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 64/122] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:11 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:12.127502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.128262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.135492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.136024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.136863 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.137301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.167354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.168005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.174385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.174826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.175588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.176019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.392526 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.400529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4105e7c3-db51-4099-aed7-dfb7d32204a0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.276911 Jul 14 15:57:12.401112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 59/123] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:12.405176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.412936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0868c2a-f467-4eae-bd9c-63cb094a05ce tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.249470 Jul 14 15:57:12.413498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 65/124] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:12.658922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.659456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.666394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.666888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.667696 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.668155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.771935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.772609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.784345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.785347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.786291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.787515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.819898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.828719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5cad04cd-c235-4112-8b5a-5724514e754b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.173764 Jul 14 15:57:12.839024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 60/125] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:12.953678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.963112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-57aacf22-8625-4571-bdfe-4f21e10c0143 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.197170 Jul 14 15:57:12.968231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 66/126] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:13.419078 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.419686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.429158 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.429602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.430399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.430827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.430917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.431509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.438079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.438429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.439201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.439639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.688747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.694135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.697447 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff10a646-64af-461d-9ea4-e95678b74ee0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.283427 Jul 14 15:57:13.698379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 61/127] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:13.702341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf96288f-1846-44cb-a262-ca000f9ac089 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.276159 Jul 14 15:57:13.702925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 67/128] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:13.846815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.847507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.854164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.854624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.855399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.855837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.860146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:13.990085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.992248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.003442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.003944 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.005204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.006071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.025691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.034610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4de7188a-96c2-4619-a2b0-e22e93e086e0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.191560 Jul 14 15:57:14.038332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 62/129] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.167461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.177323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6d28f895-31d8-435b-b4da-c7b9bc60fbe1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.199979 Jul 14 15:57:14.181620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 68/130] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:14.718626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.719255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.719689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.720328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.726264 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.726890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.727286 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.727834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.728053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.728314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.729172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.729758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.941165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.942557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.953005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c62e91c-99d5-45b0-a119-9bbcf3c7beb9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.241022 Jul 14 15:57:14.953289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2cde0ec9-1069-4fbb-aa09-9f6552480a78 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.237488 Jul 14 15:57:14.953959 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 63/131] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.956503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 69/132] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:15.054621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.055240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.061282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.061737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.062504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.062942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.195313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.196066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.202250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.202706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.203436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.203561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.203894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.213192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-be5b1b3b-e46a-46bc-9f67-75b7a20ace9f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.162947 Jul 14 15:57:15.213773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 64/133] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:15.355932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.363931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffd5a61f-99da-4fac-bd80-3b1486dd38bf tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.173080 Jul 14 15:57:15.373442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 70/134] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:15.970735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.971340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.979330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.985198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-d28f4e3b-5957-4f6a-842f-50a39aa6458e req-3d750e8b-433d-4f0a-b6ba-49cc98c27365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06201b79-aa1b-474d-8a40-6ef60e0498fd", "name": "network-vif-plugged", "status": "completed", "tag": "3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:15.990135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.991008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.991457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.002127 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d28f4e3b-5957-4f6a-842f-50a39aa6458e req-3d750e8b-433d-4f0a-b6ba-49cc98c27365 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.002127 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d28f4e3b-5957-4f6a-842f-50a39aa6458e req-3d750e8b-433d-4f0a-b6ba-49cc98c27365 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.023280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-d28f4e3b-5957-4f6a-842f-50a39aa6458e req-3d750e8b-433d-4f0a-b6ba-49cc98c27365 service nova] Creating event network-vif-plugged:3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad for instance 06201b79-aa1b-474d-8a40-6ef60e0498fd on hv-cinder-84986 Jul 14 15:57:16.028783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-d28f4e3b-5957-4f6a-842f-50a39aa6458e req-3d750e8b-433d-4f0a-b6ba-49cc98c27365 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132508 Jul 14 15:57:16.029625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 65/135] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:16.035692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.037268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.047008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.047008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.047008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.047008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.212187 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.219686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0c46e1a5-838b-4770-9e3f-e6a49baa5915 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.253507 Jul 14 15:57:16.220289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 71/136] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:16.231806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.233828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.239478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.245864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.246369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.248919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.249369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.250815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87f4d236-a8af-4224-8a81-b18114ffce8b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.219723 Jul 14 15:57:16.251406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 66/137] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:16.383878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.384973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.393778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.394388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.395636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.398342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.399208 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.408479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20838f3a-7784-477a-8d67-6914ffa375ab tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.181757 Jul 14 15:57:16.409293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 72/138] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:16.560084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.567827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85fdb1f5-cc8b-45af-9c62-af3d128317fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.190205 Jul 14 15:57:16.572140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 67/139] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:17.237405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.238119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.246179 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.246796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.247713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.248397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.270046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.271406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.279434 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.280134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.282363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.282363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.506092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.516047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e82cb47a-417f-4a87-a9d8-79090d821dae tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.251069 Jul 14 15:57:17.519557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 68/140] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.524817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.534583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a23c8d1-1dd3-4b04-8848-685ee7252d25 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.301307 Jul 14 15:57:17.538250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 73/141] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.541715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.542522 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.548870 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.549492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.550595 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.551030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.585613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.587375 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.599400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.600300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.603977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.607426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.805478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.824519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f7c35200-584e-4f8d-a0e6-417b49191808 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.294715 Jul 14 15:57:17.825105 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 69/142] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.837545 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.845229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac2d5291-6828-49c3-82f6-151bba5e6ec7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.264573 Jul 14 15:57:17.845863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 74/143] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:18.532906 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.533443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.539811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.540299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.541064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.541530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.557574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.557574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.558165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:18.562867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.563479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.564362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.564972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.685877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:18.754476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.758571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.768993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e2be55b4-53ac-4158-9435-c93accfb7d6d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.239723 Jul 14 15:57:18.769783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0490c611-a326-4b06-90b4-71ceaf102d4a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.218805 Jul 14 15:57:18.770416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 70/144] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:18.772690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 75/145] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:18.841349 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.841962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.847870 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.848364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.849145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.849671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.862851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.863703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.870556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.871086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.871977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.872531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.063336 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.070456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.072360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d4d1d5a5-7311-446e-9da2-9bbe529f17ea tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.234779 Jul 14 15:57:19.073390 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 71/146] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:19.078157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d24c5a5-e867-4c2b-b2c2-99235aa8e7a9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.219092 Jul 14 15:57:19.078790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 76/147] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:19.787214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.788000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.794651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.795109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.795895 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.796436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.799726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.801864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.813143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.813768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.814663 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.815757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.031552 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.041227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.044476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fa9e7fa-c749-40b8-9e3f-99a949bc122f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.261507 Jul 14 15:57:20.048862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b750adea-f2c0-437e-8ca8-cf0f2f715471 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.254910 Jul 14 15:57:20.055783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 72/148] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.059043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 77/149] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.090361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.091007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.094213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:20.095248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.095950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.097834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.098283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.098881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:20.099167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.100187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.105159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.106464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.109102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.109102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.328318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.338092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.340778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c0061ad-9673-47f5-a22d-7a75ffb304ff tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.254149 Jul 14 15:57:20.342348 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 73/150] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.346675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-260bb99b-f3d3-416b-ac97-1f59303c8320 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.255768 Jul 14 15:57:20.347236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 78/151] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:21.069341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.070704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.071321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.074006 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.081457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.081972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.082221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.082669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.084340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.084663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.084775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.085235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.493034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.499872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.501507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bf7b76db-de4a-4a8f-9c5a-f1121e259563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.439402 Jul 14 15:57:21.502302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 79/152] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:21.518824 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a7fd0100-3eca-4236-9eb0-4250b98510ab tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.460889 Jul 14 15:57:21.520697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.522269 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.524488 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 74/153] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:21.529366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.529494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.530206 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.530424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.531519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.532136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.539343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.544057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.544057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.544057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.731137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.738451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.748047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ae28a0a-90c2-4290-a4af-234e5c947e6d tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.244549 Jul 14 15:57:21.748427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f831aff-9bd3-4749-bee2-b8b5f7c95496 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.222521 Jul 14 15:57:21.748808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 80/154] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:21.752418 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 75/155] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:22.522943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.523549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.529738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.530173 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.530925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.531405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.541299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.541299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.546937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.547381 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.548163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.548593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.549874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:22.747484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.750443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.761365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c0f93dd-2d26-4ebe-884b-2d8150918458 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.242015 Jul 14 15:57:22.761967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 81/156] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:22.767049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ba8e2b5-dd94-4578-bbaf-9916162ea56d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.229251 Jul 14 15:57:22.769466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 76/157] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:22.779280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.780598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.783000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.784217 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.789262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.790051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.791276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.791863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.793446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.795105 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.796263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.797047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.035473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.051714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-caa416e8-5a06-4586-b9cf-0238c3e65e80 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.279460 Jul 14 15:57:23.052334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 77/158] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:23.086695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.098106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b8f2b102-ddfd-4766-8ad2-b277e2e7e269 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.334319 Jul 14 15:57:23.098695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 82/159] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:23.778307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:23.779313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:23.784573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:23.785879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:23.786025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.786440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.787549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.788047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.792220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.794323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.794323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.794323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.032610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.041281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-524e44fa-4189-4d82-b384-283699610879 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.266775 Jul 14 15:57:24.041876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 78/160] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:23 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:24.068832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.069463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.076968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.077149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.077425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.078214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.078655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.088073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cdaf582a-d944-4d76-9647-cc84f6b7bfef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.307711 Jul 14 15:57:24.099169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 83/161] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:23 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:24.103836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:24.115477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.116388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.128443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.131840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.133683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.134505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.281089 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.306402 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-898bff89-7e14-4d6b-829a-71e347aa07c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.237927 Jul 14 15:57:24.307112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 79/162] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:24.325306 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.335331 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-50ecccf2-108e-427b-a72a-62b9fd72cf04 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.224416 Jul 14 15:57:24.336621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 84/163] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:25.058689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.059295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.065933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.066379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.067166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.067598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.106778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.110659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.115800 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.116484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.117557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.118244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.258289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.270070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdb38944-32c7-4235-81f4-ae9ca5b83e49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.214887 Jul 14 15:57:25.282640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 80/164] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:25.325473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.326086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.327162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.333903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.334635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.335447 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-03d2b10f-2dfb-4a88-8601-2402f9433c21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.232381 Jul 14 15:57:25.335943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.336708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.355784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 85/165] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:25.360673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.361285 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.382357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.382357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.382357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.390370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.568808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.577029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba9b6127-2907-4b1b-a6bb-0e634935ce0a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.257191 Jul 14 15:57:25.578049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 81/166] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:25.597441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.606302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67d096a5-3853-4c11-bac5-c12c248411cc tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.249364 Jul 14 15:57:25.606875 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 86/167] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.288550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.289290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.295414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.296004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.296907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.297403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.354139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.355203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.366952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.367315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.375552 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.376187 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.538216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.548199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f47b65a6-2f32-4046-97b4-756523256618 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.264178 Jul 14 15:57:26.557628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 82/168] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.569063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.576698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b6e42342-384c-4caf-93cc-62500254ebb4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.227998 Jul 14 15:57:26.577395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 87/169] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.596495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.596495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.602121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.602747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.603515 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.603946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.625650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.626800 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.637050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.637659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.639112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.640027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.811503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.824958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-04d06d72-7e21-4743-8b09-cb7f1629e368 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.229445 Jul 14 15:57:26.836822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 83/170] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.848291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.856961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-48a7b4c0-0953-4f6a-8850-56ffceeb1dd8 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.237362 Jul 14 15:57:26.857772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 88/171] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:27.564826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.568440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.571912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.572395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.573164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.573596 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.595719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.597253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.604489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.605029 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.608505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.608505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.768485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.777406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a28a41d4-45d1-4514-9a06-944f870beb64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.216650 Jul 14 15:57:27.778256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 84/172] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:27.797052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.806358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58efced8-fe59-4805-a9b0-aac51901c060 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.215185 Jul 14 15:57:27.806939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 89/173] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:27.843264 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.844308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.859474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.859474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.859474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.859474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.875176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.875926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.884051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.884584 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.886676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.887341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.071106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.078701 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.079782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-40d64b19-704f-43c0-960b-22d2f2e5ce13 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.240619 Jul 14 15:57:28.080722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 85/174] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:28.091057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-26d20b9c-a374-4d32-bf22-21154d97dd44 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.219958 Jul 14 15:57:28.091631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 90/175] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:28.788326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-030c071f-1216-49f0-a238-e12172c810ad req-4c8d87c4-e6ef-4449-a2b0-685b18ab6352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d91ec6-f9a0-44a2-8b49-d337f3c3b36e", "name": "network-vif-plugged", "status": "completed", "tag": "3fcbf50b-887c-4db2-b9dc-4803059614b5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:28.795759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.797394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.798757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-030c071f-1216-49f0-a238-e12172c810ad req-4c8d87c4-e6ef-4449-a2b0-685b18ab6352 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.799703 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-030c071f-1216-49f0-a238-e12172c810ad req-4c8d87c4-e6ef-4449-a2b0-685b18ab6352 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.805461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.806602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.807711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.808369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.813758 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-030c071f-1216-49f0-a238-e12172c810ad req-4c8d87c4-e6ef-4449-a2b0-685b18ab6352 service nova] Creating event network-vif-plugged:3fcbf50b-887c-4db2-b9dc-4803059614b5 for instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e on hv-cinder-84986 Jul 14 15:57:28.819688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-030c071f-1216-49f0-a238-e12172c810ad req-4c8d87c4-e6ef-4449-a2b0-685b18ab6352 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036369 Jul 14 15:57:28.820321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 86/176] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:28.827020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.827020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.832316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.833072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.834615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.835052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.027013 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.034392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.036590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ebc4100-982c-4b1d-9a40-a1b9890a641f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.245837 Jul 14 15:57:29.037354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 91/177] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:29.044267 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d353c12b-1078-4bd0-9ca2-3733d36a056e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.222726 Jul 14 15:57:29.045106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 87/178] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:29.098080 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.098709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.104783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.105283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.106128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.106753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.109333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.109972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.117580 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.118027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.118805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.119247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.305350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.309559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.312918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b941e363-5e7b-4833-933a-7c6a7d8e1cdb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.218923 Jul 14 15:57:29.313570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 92/179] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:29.317303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b6fda1a-156d-4aaf-993d-dd704cb4b7e9 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.212870 Jul 14 15:57:29.318000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 88/180] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:30.054340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.056232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.063083 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.064387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.065092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.071070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.071070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.071070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.074335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.075181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.076214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.076766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.277002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.283160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.292692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c031b3e5-1fa7-494f-9959-809e217e10da tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.242017 Jul 14 15:57:30.293923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 93/181] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.306765 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f4e57a2c-b9f8-40d0-be60-6967ec9bbbf0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.247540 Jul 14 15:57:30.307474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 89/182] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:30.331859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.333072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.338003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.338616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.340409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.340865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.341632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.342239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.344805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.345761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.346535 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.347697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.554853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.558477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.562921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ebbe8ea2-8b33-487c-bed3-82d9f20c0b05 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.235233 Jul 14 15:57:30.563502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 94/183] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.576014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-caee83a3-1ed9-4a97-b85b-4ce8f1a11093 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.242511 Jul 14 15:57:30.576613 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 90/184] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.835128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-ae1f8eaa-138e-40f6-bf07-fc581f7de461 req-53af4984-d144-46ae-a59d-c5eaaa6316cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599bf41f-04fc-42f6-8c4c-5946659a0fee", "name": "network-vif-plugged", "status": "completed", "tag": "06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:30.844353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ae1f8eaa-138e-40f6-bf07-fc581f7de461 req-53af4984-d144-46ae-a59d-c5eaaa6316cc service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.844847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ae1f8eaa-138e-40f6-bf07-fc581f7de461 req-53af4984-d144-46ae-a59d-c5eaaa6316cc service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.859180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-ae1f8eaa-138e-40f6-bf07-fc581f7de461 req-53af4984-d144-46ae-a59d-c5eaaa6316cc service nova] Creating event network-vif-plugged:06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b for instance 599bf41f-04fc-42f6-8c4c-5946659a0fee on hv-cinder-84986 Jul 14 15:57:30.864496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-ae1f8eaa-138e-40f6-bf07-fc581f7de461 req-53af4984-d144-46ae-a59d-c5eaaa6316cc service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033921 Jul 14 15:57:30.865092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 95/185] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:31.519483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.519483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.519483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.519483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.520685 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.520685 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.520817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.520817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.520817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.520817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.521465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.521465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.904072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.921550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1af85f65-522f-4c26-9ee4-71ad9f4a130f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.599705 Jul 14 15:57:31.935782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 96/186] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:31.938971 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.942759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.944202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.953785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f3d1d12-44f7-465d-b6be-483a50afbd19 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.644394 Jul 14 15:57:31.954619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 91/187] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:31.969382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.970250 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.976007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.977717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.977717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.978416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.992004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.992741 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.993667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.994188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.437991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.446802 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f7126634-4284-4743-b2fc-7fa3f417454a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.509315 Jul 14 15:57:32.447965 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 97/188] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:32.454781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.463259 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4aa3fe7-5bb7-444a-a15e-c0bae2cc3d2c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.507357 Jul 14 15:57:32.463909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 92/189] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:32.879395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-9005506b-1240-4f8c-97c4-b783f1dc02ae req-72d446b6-6ede-4553-8f76-ab7c025246ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41756c6f-5714-4b75-b3fb-ee75edcac924", "name": "network-vif-plugged", "status": "completed", "tag": "fd63becb-ed28-4d91-8401-801a37b8d3fa"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:32.889397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-9005506b-1240-4f8c-97c4-b783f1dc02ae req-72d446b6-6ede-4553-8f76-ab7c025246ac service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.889902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-9005506b-1240-4f8c-97c4-b783f1dc02ae req-72d446b6-6ede-4553-8f76-ab7c025246ac service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.902569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-9005506b-1240-4f8c-97c4-b783f1dc02ae req-72d446b6-6ede-4553-8f76-ab7c025246ac service nova] Creating event network-vif-plugged:fd63becb-ed28-4d91-8401-801a37b8d3fa for instance 41756c6f-5714-4b75-b3fb-ee75edcac924 on hv-cinder-84986 Jul 14 15:57:32.908342 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-9005506b-1240-4f8c-97c4-b783f1dc02ae req-72d446b6-6ede-4553-8f76-ab7c025246ac service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Jul 14 15:57:32.913299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 98/190] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:32.941847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.942540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.949259 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.949785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.950642 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.951152 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.972312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.973027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.979887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.986317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.986317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.986317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.999901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:33.177181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.185407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cf3ca06-e454-476b-91b4-dcdeeb002d58 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.247411 Jul 14 15:57:33.186018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 93/191] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:33.205781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.207281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20ddad7c-0732-4bbd-b154-1fef0464e4ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.239149 Jul 14 15:57:33.208148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 99/192] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:33.464457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:33.465065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:33.471148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.471589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.472364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.472955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.482629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:33.492717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:33.494194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.495003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.496227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.496897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.685358 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.699828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.707185 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc69aed2-370a-4391-ba21-1cae63415be1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.246557 Jul 14 15:57:33.712161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1faf65a-d71a-482c-ba47-742144d07368 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.235525 Jul 14 15:57:33.713056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 94/193] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:33.721831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 100/194] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.202778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.203388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.209880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.210328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.211101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.211540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.225916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.227134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.233350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.234016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.234774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.235205 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.429132 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.437621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.440847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-69c79656-54fd-498f-b3d8-35f432048787 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.241942 Jul 14 15:57:34.442419 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 95/195] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.452769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3da822fc-c7bd-491d-9888-272dad1513c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.231259 Jul 14 15:57:34.453537 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 101/196] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:34.729273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.732260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.737651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.738263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.744798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.745001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.745264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.745809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.746067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.746735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.747122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.747571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.946347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.952593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.953885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d43881f-3b03-46b1-b0a2-1d02257cd110 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.219905 Jul 14 15:57:34.954894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 102/197] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.966404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:34.971026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dec32f00-9748-4407-a39b-1323caa6d840 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.245773 Jul 14 15:57:34.971588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 96/198] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:35.457907 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.458819 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.471249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.471249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.484829 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.485030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.485493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.485803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.486231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.486662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.487017 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.487564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.697673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.702036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.705441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9795f301-9b47-4052-b9a2-23aa99487703 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.251828 Jul 14 15:57:35.706010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 103/199] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:35.710505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67e2aa15-108f-48a8-b0aa-8b217f6c3079 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.243646 Jul 14 15:57:35.711349 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 97/200] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:35.976947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.977561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.984865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.985316 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.986086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.986733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.986855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.987463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.994536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.997169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.997169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.997169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.205792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.210221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.214706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8567fa62-4b34-467f-b900-d556a7635246 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.242660 Jul 14 15:57:36.215458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 104/201] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:36.218070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46fc0991-40bf-4c4c-8d5b-af52c362566c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.234926 Jul 14 15:57:36.218560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 98/202] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:36.722498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.723146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.728437 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.729519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.729724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.730176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.731085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.731529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.736215 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.736708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.737537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.738008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.981383 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.990567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-248a569a-4d03-480a-9bff-4a9a8dbbd920 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.271454 Jul 14 15:57:36.991376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 105/203] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:36.996600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:37.010641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9b944009-e26f-415c-b2b6-0ab98eaedc86 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.287452 Jul 14 15:57:37.011763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 99/204] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:37.232159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.233406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.239322 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.244599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.244738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.244817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.244817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.244817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.265170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.268818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.270762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.271836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.533632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:37.539352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:37.542344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e06b24d3-b726-43ae-83ec-9b8e031dbd38 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.314481 Jul 14 15:57:37.542868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 106/205] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:37.547158 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0151df8f-7832-46fe-a03e-42fcfeb19ec1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.316054 Jul 14 15:57:37.547819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 100/206] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:38.009959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.011185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.018162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.018614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.020729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.020729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.032555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.033720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.040305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.040974 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.041931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.042510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.244513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.248993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.253046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc24e36b-05f1-4c48-ab80-0caa2f967e21 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.248342 Jul 14 15:57:38.253726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 107/207] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:38.263237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb8c2f3b-83c9-4a70-9ea7-43f6435a2e18 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.229423 Jul 14 15:57:38.263237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 101/208] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:38.559799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.561077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.563508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.564360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.571556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.572003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.572810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.573246 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.576018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.576709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.577881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.578621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.781494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.785698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.790041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37d4827e-414f-483c-84b3-4dcb5265969a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.234106 Jul 14 15:57:38.790687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 102/209] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:38.793881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9bcdcd7f-f81e-42c0-9df6-403d9dd71a54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1326 microversion: 2.1 time: 0.234176 Jul 14 15:57:38.794448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 108/210] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1326 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:39.277962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.279222 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.280363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.281205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.293458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.295899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.297353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.303997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.306400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.306400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.306605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.311195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.741728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.744754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.757930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aaff6763-9a99-4373-b807-eacc53b8f475 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.491249 Jul 14 15:57:39.758542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 103/211] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:39.759447 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f8c9d23-33df-4ea0-99f9-39e1982a9889 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.487911 Jul 14 15:57:39.764775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 109/212] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:39.770220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-d7e47884-cc76-4857-ae6d-66a77f4220e5 req-f1f5c7ce-ce9e-40e5-a93b-ad402afa8d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9596a1-f8ec-4682-a980-392e550ebc33", "name": "network-vif-plugged", "status": "completed", "tag": "a289ebfe-7229-4303-8c8b-17ea1de7a70e"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:39.778455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d7e47884-cc76-4857-ae6d-66a77f4220e5 req-f1f5c7ce-ce9e-40e5-a93b-ad402afa8d9e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.778894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d7e47884-cc76-4857-ae6d-66a77f4220e5 req-f1f5c7ce-ce9e-40e5-a93b-ad402afa8d9e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.790168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-d7e47884-cc76-4857-ae6d-66a77f4220e5 req-f1f5c7ce-ce9e-40e5-a93b-ad402afa8d9e service nova] Creating event network-vif-plugged:a289ebfe-7229-4303-8c8b-17ea1de7a70e for instance 5f9596a1-f8ec-4682-a980-392e550ebc33 on hv-cinder-84986 Jul 14 15:57:39.795253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-d7e47884-cc76-4857-ae6d-66a77f4220e5 req-f1f5c7ce-ce9e-40e5-a93b-ad402afa8d9e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029065 Jul 14 15:57:39.795844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 110/213] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:39.807346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.807958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.811335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.812032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.814032 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.814485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.815249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.815686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.819029 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.819489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.820294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.820735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.015496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.019548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.023325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7cb8839e-6db0-4330-9798-fbd934baf50c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.219758 Jul 14 15:57:40.034576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 104/214] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.034834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9cda7511-4738-4fb8-aaae-ccc817c12d54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1520 microversion: 2.1 time: 0.220945 Jul 14 15:57:40.034834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 111/215] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:40.046190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:40.047308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.055174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.055628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.056764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.057206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.126779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'flavor' on Instance uuid 06201b79-aa1b-474d-8a40-6ef60e0498fd {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:57:40.540786 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8fc8eca0-4a7e-41c6-a886-4b3f80bbeb32 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd/action" status: 200 len: 32 microversion: 2.1 time: 0.498420 Jul 14 15:57:40.541534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 105/216] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 15:57:40 2022] POST /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd/action => generated 32 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:57:40.555378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.555991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.562105 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.562547 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.563301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.563732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.696522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.703952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f875832b-a58e-4836-8f17-ccae8ced7d96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.152541 Jul 14 15:57:40.704487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 112/217] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.776011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.776250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.776820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.777015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.783105 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.783562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.783699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.784200 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.784309 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.784740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.784973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.785410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.985897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.989872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.993967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b907bdc6-1c58-46e7-9a68-ea8d0a25407d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.221511 Jul 14 15:57:40.994562 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 113/218] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:40.997990 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08a24966-83e5-48d0-b092-bc751f77ef88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.226464 Jul 14 15:57:40.998612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 106/219] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:41.040425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.041202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.047133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.047660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.048697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.049066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.195381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.202715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bcbe5690-4fcd-4d24-b1d2-78adb2fb72c5 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.166298 Jul 14 15:57:41.203289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 114/220] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:41.721367 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.721924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.728271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.728623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.729383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.729817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.866529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.874162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f36566b4-36a5-49cb-8f9a-bc2d3dfcb6de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.156667 Jul 14 15:57:41.874737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 107/221] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:42.011838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.012494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.014531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.015220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.018954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.019404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.020198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.020631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.021441 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.022126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.022896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.023341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.226786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.231469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.235752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c96d83a-c5b1-4ee1-8ed0-9c767d815545 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.228262 Jul 14 15:57:42.236350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 115/222] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:42.241621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.242222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.247963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.248342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17bfd6c2-92fd-4ebd-8d9a-087df69348dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.237510 Jul 14 15:57:42.248512 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.248923 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 108/223] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:42.249265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.249764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.377988 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.381918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:42.386202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-954bba27-f3bc-4588-a45e-496f1e146d7f tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.148835 Jul 14 15:57:42.386771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 116/224] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:42.890584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.891188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.897457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.897913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.898675 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.899108 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.029403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.037785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0d4e7cb-048f-4614-91bf-63a80a695a2c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.150062 Jul 14 15:57:43.038366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 109/225] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:43.252473 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.253104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.259937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.260411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.261185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.261623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.264581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.265541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.272789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.273468 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.274399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.275143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.472343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.480495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf380f5d-4523-4ea1-a655-c9d2332b113f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.231817 Jul 14 15:57:43.480995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 117/226] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:43.484488 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.485744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.486353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.492649 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.493098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.501650 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab4bc20d-b646-4631-946f-dbed043bece7 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.232867 Jul 14 15:57:43.501764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.501844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 110/227] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:43.501929 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.635187 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.643731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-429ccf4e-80be-468d-93f7-9f28ed65e997 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.161762 Jul 14 15:57:43.644340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 118/228] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.054965 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.055667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.062010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.062510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.063351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.063836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.086994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:44.207565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.215716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d3c71735-d054-4180-b710-a68595a3fba8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.165189 Jul 14 15:57:44.216319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 111/229] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.497136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.497789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.503813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.504302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.505054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.505516 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.517046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.517714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.524327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.524911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.525685 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.526116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.742429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.750674 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff072e41-3060-47e1-801e-62061b553c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.257213 Jul 14 15:57:44.760688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 119/230] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.761040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.761147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.761147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.764941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9be345dd-573b-43cb-aa7e-af649dd9fe5a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.251893 Jul 14 15:57:44.765771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.765887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 112/231] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:44.766138 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.767173 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.767675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.917341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.926495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04f6f715-c8b5-4457-8e59-8c05f80ddcd3 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.172482 Jul 14 15:57:44.927083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 120/232] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:45.232339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.233069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.239051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.239470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.240624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.241061 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.379939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.386826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9068c018-072b-437d-b03f-92d25f680489 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.158318 Jul 14 15:57:45.387457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 113/233] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:45.768622 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.769318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.779660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.780401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.784237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.784237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.784448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.785722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.797287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.798246 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.799056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.799495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.032886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.037566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.042955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1177d5b-295f-4cf3-b55f-bc7321499b45 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.278316 Jul 14 15:57:46.053103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 121/234] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:46.053103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.053103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.061360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.062273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.063359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.063880 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.070511 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4782699d-d147-4667-9a7d-9850b5628d1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.291918 Jul 14 15:57:46.071170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 114/235] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:46.228907 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.236499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc282dfd-e2df-4cbb-89b5-f97efc112788 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1319 microversion: 2.1 time: 0.191458 Jul 14 15:57:46.237069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 122/236] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:46.404583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.405211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.411127 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.411581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.412592 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.412921 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.566188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.576910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a716df3d-7088-4b2c-b574-6d2edab68bda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.176118 Jul 14 15:57:46.577717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 115/237] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:47.061340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.062659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.069983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.082719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.082719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.088888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.089505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.095762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.096266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.097038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.097474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.288629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.296482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.299241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-39c1f7d3-739b-49ba-adec-3fc7ad4d9e5c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.241900 Jul 14 15:57:47.300195 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 123/238] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:47.305109 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.306025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.311983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.312402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.313160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.313589 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.315091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-585355d3-c2e6-40f2-af64-a0982de88a97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.230019 Jul 14 15:57:47.316448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 116/239] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:47.462602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.470283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1ff4396c-37f3-4cce-a69b-8f71fe85a5d6 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1505 microversion: 2.1 time: 0.169470 Jul 14 15:57:47.470852 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 124/240] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:47.595428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.596029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.602778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.608502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.608502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.608502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.741025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.748559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65d95779-0759-4ae1-8c35-cefe6c616e22 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.156942 Jul 14 15:57:47.749122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 117/241] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:48.317372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.318270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.324829 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.326254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.326254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.326458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.332444 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.333342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.339978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.340473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.341266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.341705 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.528995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.536324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.538746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f924d394-e24f-47f5-9f4d-d447a160c7b4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1367 microversion: 2.1 time: 0.210008 Jul 14 15:57:48.539375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 118/242] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:48.549699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0cb887d-cc28-4afb-8cbc-2a7b4cf8ad38 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.236239 Jul 14 15:57:48.567216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 125/243] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:48.765553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.766282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.773363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.773812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.774628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.775044 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.034157 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.046644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26c9c42f-ec6b-40ef-ba8a-6f6709557f44 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.285337 Jul 14 15:57:49.047744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 119/244] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:49.554910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.557879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.561556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.562001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.562859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.563287 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.586512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.586512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.593137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.593854 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.594630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.595220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.803573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.806871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.813079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4b48f5c8-7fff-4df6-8cf9-b94048f934ca tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1553 microversion: 2.1 time: 0.262100 Jul 14 15:57:49.814063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 126/245] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:49.823277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cbff72db-0f8c-4901-9476-f1ff244e8db1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.244424 Jul 14 15:57:49.823899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 120/246] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:49.830635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.831131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.837610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.838050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.838925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.839362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.995512 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-552ffc1c-dddb-4cdb-a87f-ada43423eb16 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168416 Jul 14 15:57:49.996687 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 127/247] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:50.063682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:50.064330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:50.071253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.071700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.072485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.073015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.435423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.443618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f4355440-0dff-4e7e-b915-81e306ea501f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.384017 Jul 14 15:57:50.444243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 121/248] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:50 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:50.841754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:50.842435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:50.844501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=99 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:50.850562 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.851009 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.851780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.852276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.196466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:51.204055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7ce6c94a-ffcf-42eb-bbcc-28a1a7e48796 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.367027 Jul 14 15:57:51.204669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 128/249] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:50 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:51.460881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:51.461559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:51.463470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=97 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:51.468214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.468660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.469421 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.469850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.687145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:51.695243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a3c3e1aa-56df-44c7-9a6f-6584cf8f3d61 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.238753 Jul 14 15:57:51.695949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 122/250] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:51 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:51.793223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2773ab48-1ee6-4099-871e-ab522998ea05 req-5f3fd209-df6e-4fd0-82b2-2c6074ed17a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d91ec6-f9a0-44a2-8b49-d337f3c3b36e", "tag": "3fcbf50b-887c-4db2-b9dc-4803059614b5"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:51.802007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2773ab48-1ee6-4099-871e-ab522998ea05 req-5f3fd209-df6e-4fd0-82b2-2c6074ed17a1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.802980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2773ab48-1ee6-4099-871e-ab522998ea05 req-5f3fd209-df6e-4fd0-82b2-2c6074ed17a1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.815195 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2773ab48-1ee6-4099-871e-ab522998ea05 req-5f3fd209-df6e-4fd0-82b2-2c6074ed17a1 service nova] Creating event network-changed:3fcbf50b-887c-4db2-b9dc-4803059614b5 for instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e on hv-cinder-84986 Jul 14 15:57:51.822453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2773ab48-1ee6-4099-871e-ab522998ea05 req-5f3fd209-df6e-4fd0-82b2-2c6074ed17a1 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Jul 14 15:57:51.823902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 129/251] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:52.222459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:52.223064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:52.231176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.231947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.232956 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.233393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.384654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.393950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f80d35ae-529f-4de7-afe3-520ecfede340 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.175670 Jul 14 15:57:52.394869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 123/252] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:52 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:52.713016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:52.713853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:52.720046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.720524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.721298 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.721735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.862359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.870734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-db8e07b8-c12b-4535-a30f-f7899a3c60fa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.162043 Jul 14 15:57:52.871307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 130/253] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:52 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:53.411109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:53.411729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:53.418655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.419109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.419884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.420352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.577465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:53.585654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ce90438-113a-4c01-a7ba-0332713280aa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.178603 Jul 14 15:57:53.586239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 124/254] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:53 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:53.887621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:53.888379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:53.894736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.895184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.895946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.897068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.042896 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.050488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f97a909d-1888-4f3a-8cb1-1ad1e0fb0890 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.166796 Jul 14 15:57:54.051094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 131/255] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:53 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:54.603106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:54.603751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:54.610429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.610881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.611646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.612134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.782266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.790661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3bfd1ce2-25ad-4272-9212-c978662e2ed6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1371 microversion: 2.1 time: 0.192458 Jul 14 15:57:54.791242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 125/256] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:54 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:55.069419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.070113 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:55.076643 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.077102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.077874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.078311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.212129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.223600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7162cda-b6cb-4ae6-8455-f734eb3cbb15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.157006 Jul 14 15:57:55.235664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 132/257] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:55.807084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.807947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:55.814145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.815233 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.816091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.816764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.967672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.975530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9b880b2a-2377-4ae9-93c1-b999abc7c03b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1561 microversion: 2.1 time: 0.172478 Jul 14 15:57:55.976138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 126/258] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:55.994067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.994558 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.008122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.008122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.013504 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.013952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.128873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bf71d918-7fbe-4086-a3a1-f1080eda185f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138756 Jul 14 15:57:56.132045 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 133/259] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:56.242805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.244042 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.250896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.251738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.252925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.253564 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.604636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a6041b7-cac7-4e89-9caa-0a620bb7be04"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:56.605795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.613001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.613824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.614956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.615500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.700496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:56.781256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.789459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-948ccf98-c69e-429e-926a-26e6eecf24d1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.551635 Jul 14 15:57:56.790245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 127/260] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:56 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:57.627439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-46819e25-e8f4-445b-8674-9f93de0c09e2 req-4e39599c-4688-4ee0-840d-f601d943b0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41756c6f-5714-4b75-b3fb-ee75edcac924", "tag": "fd63becb-ed28-4d91-8401-801a37b8d3fa"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:57.636893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-46819e25-e8f4-445b-8674-9f93de0c09e2 req-4e39599c-4688-4ee0-840d-f601d943b0a6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.637430 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-46819e25-e8f4-445b-8674-9f93de0c09e2 req-4e39599c-4688-4ee0-840d-f601d943b0a6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.643151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:57.652392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-46819e25-e8f4-445b-8674-9f93de0c09e2 req-4e39599c-4688-4ee0-840d-f601d943b0a6 service nova] Creating event network-changed:fd63becb-ed28-4d91-8401-801a37b8d3fa for instance 41756c6f-5714-4b75-b3fb-ee75edcac924 on hv-cinder-84986 Jul 14 15:57:57.657627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-46819e25-e8f4-445b-8674-9f93de0c09e2 req-4e39599c-4688-4ee0-840d-f601d943b0a6 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034016 Jul 14 15:57:57.658262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 128/261] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:57.809111 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:57.809903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:57.828271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.828271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.828271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.828271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.967942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.978747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c96996ab-2e94-497c-ae47-9cf97b78e7bb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.174665 Jul 14 15:57:57.979340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 129/262] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:57 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:58.995103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.996473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:59.002916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.003391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.004298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.004637 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.149258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:59.157224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3329c198-1f5a-4f1b-b0ec-187a50779fa3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.166118 Jul 14 15:57:59.157819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 130/263] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:00.173776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.174345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.181157 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.181608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.182373 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.182807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.309827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.317698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0124f3a7-a53e-434b-af3d-f239e9b601d7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.147825 Jul 14 15:58:00.327145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 131/264] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:01.335838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:01.336492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:01.342746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.343188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.343946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.344420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.493282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:01.500735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a77ded9c-2aea-401a-8fb5-fb249e7f4207 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.169789 Jul 14 15:58:01.501294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 132/265] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:01 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:02.518175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:02.519556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:02.532041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.532981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.533316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.533760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.747387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.754921 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ee0191f1-9c35-43f3-80dd-500ae6aeb4d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.240834 Jul 14 15:58:02.755520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 133/266] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:02 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:02.787505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55aa13cd-f7d6-4811-bd73-f239e3c0b097 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "POST /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.186477 Jul 14 15:58:02.793518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 134/267] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 15:57:56 2022] POST /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee/os-volume_attachments => generated 194 bytes in 6194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:03.677715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2082896771", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "networks": [{"uuid": "76d2fb51-b1c0-4365-a827-9ba97bef7a96"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:03.735057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] validate_networks() for [('76d2fb51-b1c0-4365-a827-9ba97bef7a96', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:58:03.773719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.774508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.781712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.782177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.783174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.783614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.974972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.983520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5adf51da-a4bc-4429-bee4-f15922e9bfef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.214093 Jul 14 15:58:03.983894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 135/268] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:04.366019 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:58:04.366455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:58:04.366934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:58:04.367343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:58:04.367827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:58:04.376738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.377185 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.378001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.378483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.397080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Getting quotas for project cbdae82cb97b48b7a541a22084bc111f. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:58:04.401092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Getting quotas for user 6a713d55889246049668bdb4e221c998 and project cbdae82cb97b48b7a541a22084bc111f. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:58:04.411932 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:58:04.419206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:58:04.571410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a0ff1144-4b19-4d96-b81f-197f2c90e757 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.897696 Jul 14 15:58:04.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 134/269] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:58:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:58:04.582177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba982bca-c128-40eb-9aae-8d7efbce8bc0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.582866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba982bca-c128-40eb-9aae-8d7efbce8bc0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.637003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba982bca-c128-40eb-9aae-8d7efbce8bc0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:04.643508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba982bca-c128-40eb-9aae-8d7efbce8bc0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1218 microversion: 2.1 time: 0.065292 Jul 14 15:58:04.644178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 136/270] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:04 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:04.999077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.999712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.006434 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.006853 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.007614 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.008044 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.153974 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.158948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b82ee38-0dba-42a7-98a6-49bcf7361c4a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.163588 Jul 14 15:58:05.159524 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 135/271] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:04 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:05.660941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c56a092-099a-4927-9250-e0787d130de7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:05.661487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c56a092-099a-4927-9250-e0787d130de7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.715295 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c56a092-099a-4927-9250-e0787d130de7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.723475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c56a092-099a-4927-9250-e0787d130de7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1218 microversion: 2.1 time: 0.066518 Jul 14 15:58:05.724050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 137/272] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:05 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:06.175862 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:06.176566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:06.183046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.183506 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.184556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.185052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.337421 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.345914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1cbad0d6-b6fd-49cc-a34d-19c4d100a5c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.174011 Jul 14 15:58:06.346527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 136/273] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:06 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:06.742002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:06.742538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:06.748779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.749228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.753429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.753429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.815524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.824620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bee292a3-97f3-420b-af51-6f3177a4949a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1270 microversion: 2.1 time: 0.087297 Jul 14 15:58:06.825208 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 138/274] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:06 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:07.362734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.363402 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.369691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.370131 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.370885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.371321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.575411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.583444 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fcfb060c-fa3a-4d59-b4ba-17cae658ceaa tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.224145 Jul 14 15:58:07.584665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 137/275] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:07.842507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.843951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.851985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.852673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.853912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.854562 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.939002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.949364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84f551a1-364b-48bf-8388-9e143a5f9b70 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1288 microversion: 2.1 time: 0.110872 Jul 14 15:58:07.950005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 139/276] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:08.606341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:08.615964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:08.628354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.628922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.629760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.630241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.894797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:08.902621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c7c02b3-f8c2-4a7a-8029-8b237ec96f29 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.301388 Jul 14 15:58:08.903196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 138/277] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:08 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:08.973032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:08.974230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:08.981782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.982340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.983624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.984404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.169384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.184596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-63ce2ab0-13cf-44ce-8b3f-2e26fa57ae1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.215330 Jul 14 15:58:09.190276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 140/278] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:08 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:09.535146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-e8d9e21e-1ac0-4760-bf62-089e9ff43f92 req-35cbaeb0-a717-440d-a42c-c53e3505c05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2624ad70-f118-4407-b145-3e7c44efa22f", "tag": "1c6c0b1b-7252-401d-8746-06437e0e74d5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:09.552049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e8d9e21e-1ac0-4760-bf62-089e9ff43f92 req-35cbaeb0-a717-440d-a42c-c53e3505c05e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.553307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e8d9e21e-1ac0-4760-bf62-089e9ff43f92 req-35cbaeb0-a717-440d-a42c-c53e3505c05e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.566326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-e8d9e21e-1ac0-4760-bf62-089e9ff43f92 req-35cbaeb0-a717-440d-a42c-c53e3505c05e service nova] Creating event network-changed:1c6c0b1b-7252-401d-8746-06437e0e74d5 for instance 2624ad70-f118-4407-b145-3e7c44efa22f on hv-cinder-84986 Jul 14 15:58:09.572275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-e8d9e21e-1ac0-4760-bf62-089e9ff43f92 req-35cbaeb0-a717-440d-a42c-c53e3505c05e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052003 Jul 14 15:58:09.573059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 139/279] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:09.919723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:09.920605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:09.927999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.928515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.929317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.929758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.121038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.134991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4a117ac-2e1b-48ce-b3d6-de3baab16fa7 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.216822 Jul 14 15:58:10.136146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 141/280] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:09 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:10.204240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:10.205991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:10.214062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.214739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.215674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.216383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.405739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.419030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-adead74a-a159-4533-9d88-48f2c6630a7f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.219819 Jul 14 15:58:10.419614 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 140/281] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:10 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:11.157367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:11.159215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:11.171626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.172709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.177605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.177605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.371311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.382682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89143531-e05f-4bb1-9459-032611beea21 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.231093 Jul 14 15:58:11.384523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 142/282] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:11 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:11.437464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:11.438501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:11.448521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.449264 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.450237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.450668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.661343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.669817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0d186e54-2239-4f95-8e9f-f165e2073209 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.236743 Jul 14 15:58:11.670412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 141/283] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:11 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:12.402433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:12.403161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:12.409722 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.410171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.410938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.411389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.601921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:12.610512 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb1d3cd6-ef16-495e-b7c6-cfad436234b0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.212432 Jul 14 15:58:12.611212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 143/284] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:12 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:12.690995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:12.691740 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:12.701753 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.702386 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.703183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.703619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.882940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:12.890535 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc73931e-0c5f-496a-8476-441ff99c9142 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.204307 Jul 14 15:58:12.891142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 142/285] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:12 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:13.630610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:13.631893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:13.631893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:13.632058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:13.638755 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.639022 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.639408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.639684 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.643728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.643848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.643928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.644014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.670835 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:58:13.807514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:13.815758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e062cf6-3d07-4dbf-91d3-5b77484fb2e9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.190214 Jul 14 15:58:13.816381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 144/286] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:13 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:13.913060 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:13.913570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:13.920383 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.921224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.921959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.922478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.074451 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.082494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a7cccd9f-0c35-4d00-8bb8-03ee56c76d4c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.174329 Jul 14 15:58:14.083068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 145/287] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:13 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:14.105249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a44dd07-218c-4bf7-acbd-bb1cad777bd0 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "DELETE /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 204 len: 0 microversion: 2.1 time: 0.477973 Jul 14 15:58:14.105985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 143/288] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 15:58:13 2022] DELETE /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:58:14.114717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:14.116040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:14.122909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.123426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.124300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.124784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.269348 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.277692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54ed8f64-f8fd-4f44-9c89-90964ab93542 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.167078 Jul 14 15:58:14.278264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 146/289] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:14 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:14.835891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:14.836618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:14.838548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.839245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.844125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.844772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.845488 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.845907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.984276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.992015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2a40db8-759d-4f6d-8b3c-a864fb879301 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.161184 Jul 14 15:58:14.992607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 144/290] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:14 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:15.100719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:15.101563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:15.109450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.109450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.109450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.109713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.254070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.262371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-411f4612-1efd-4dcf-a651-b76b9f4cf3a5 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.166156 Jul 14 15:58:15.262937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 147/291] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:15 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:15.299191 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:15.301035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:15.307757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.308261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.309100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.309704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.315013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:15.687027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.697396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-21bed399-f545-4dcb-8786-9053b565ca2b tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.402472 Jul 14 15:58:15.698110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 145/292] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:15 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:16.012161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.012771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.016445 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.019427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.019908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.020717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.021248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.154754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.168985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7fcdf432-bdf3-476f-86eb-7842acb3e8ef tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.161485 Jul 14 15:58:16.179254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 148/293] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:16.282559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.283201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.290297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.290835 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.291726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.292305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.462508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.472226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5e532a17-410a-4412-a477-e453ff77ab4d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.193602 Jul 14 15:58:16.472953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 146/294] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:16.717069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.717772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.723910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.724436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.725240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.725673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.873629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.882796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87f873b1-4131-4e6c-aec0-845e49947f07 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.169939 Jul 14 15:58:16.883366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 149/295] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:17.193915 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:17.195171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:17.201157 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.201572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.203521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.204161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.382753 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:17.392196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dce6c974-82fd-4add-a59f-a8c81116905a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.202978 Jul 14 15:58:17.392813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 147/296] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:17 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:17.491345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:17.491959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:17.498662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.499112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.499878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.500345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.645644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:17.653085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a5a057c2-81e4-4ee9-a363-6fc6b3882b3d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.166523 Jul 14 15:58:17.653647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 150/297] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:17 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:17.902408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:17.903134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:17.910320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.926585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.926585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.926585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.060730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.070995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ecb01e6-0d91-4b56-910f-72c91582261a tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.172923 Jul 14 15:58:18.071669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 148/298] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:17 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:18.420249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:18.420865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:18.427815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.428305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.429601 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.430084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.614698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.623340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-904da2fc-7fad-4103-b288-78098847a413 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.207126 Jul 14 15:58:18.623951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 151/299] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:18 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:18.670821 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:18.671542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:18.678466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.678945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.679821 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.680372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.819443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.827528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dae5ffb5-fa79-4712-be4a-8d56a734fcbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.160891 Jul 14 15:58:18.828109 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 149/300] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:18 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:19.088553 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:19.089162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:19.097212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.097886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.099085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.099963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.104765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:19.242954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.251007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-44b1e721-7af6-4330-ab57-6901b4ea1eee tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.166388 Jul 14 15:58:19.251571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 152/301] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:19 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:19.641778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:19.642508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:19.649582 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.650033 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.650799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.651236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.819636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.830918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01217175-4a47-4d77-915f-d12657fe73c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.193416 Jul 14 15:58:19.831649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 150/302] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:19 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:19.848898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:19.849696 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:19.857441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.857891 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.858677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.859108 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.147489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:20.154967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7273ee8a-d42a-4225-b209-4915d43cd24a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.312289 Jul 14 15:58:20.155519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 153/303] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:19 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:20.271876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:20.273618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:20.279171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.279619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.280526 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.281001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.417557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:20.426594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2b5c9502-b6d3-4341-bab3-1ecf62ad5337 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1557 microversion: 2.1 time: 0.159259 Jul 14 15:58:20.427260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 151/304] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:20 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:20.464677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-1ea1cb8d-d3ab-4795-b190-3815080af3c3 req-d8ec2e02-9724-4817-9689-7bf78aabdf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2624ad70-f118-4407-b145-3e7c44efa22f", "name": "network-vif-plugged", "status": "completed", "tag": "1c6c0b1b-7252-401d-8746-06437e0e74d5"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:20.473846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1ea1cb8d-d3ab-4795-b190-3815080af3c3 req-d8ec2e02-9724-4817-9689-7bf78aabdf48 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.474310 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1ea1cb8d-d3ab-4795-b190-3815080af3c3 req-d8ec2e02-9724-4817-9689-7bf78aabdf48 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.486125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-1ea1cb8d-d3ab-4795-b190-3815080af3c3 req-d8ec2e02-9724-4817-9689-7bf78aabdf48 service nova] Creating event network-vif-plugged:1c6c0b1b-7252-401d-8746-06437e0e74d5 for instance 2624ad70-f118-4407-b145-3e7c44efa22f on hv-cinder-84986 Jul 14 15:58:20.492351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-1ea1cb8d-d3ab-4795-b190-3815080af3c3 req-d8ec2e02-9724-4817-9689-7bf78aabdf48 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Jul 14 15:58:20.492927 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 154/305] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:58:20.854430 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:20.855125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:20.863627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.864116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.864891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.865482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.101228 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:21.109204 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d49cbdc-a656-487b-963d-9e323b93cdf9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.259696 Jul 14 15:58:21.110242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 152/306] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:20 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:21.172459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:21.173224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:21.175313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:21.180549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.181086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.181915 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.182379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.372658 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:21.380127 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8561f28e-299c-46d9-ac8c-8e2529a8311e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.212626 Jul 14 15:58:21.381564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 155/307] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:21 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:21.444628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:21.445149 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:21.451258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.451704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.452486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.452918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.636621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-eb66ff37-33bf-402c-8fd0-7743761a0717 req-e6801929-6240-4db1-ba53-470b0761859e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599bf41f-04fc-42f6-8c4c-5946659a0fee", "name": "network-vif-deleted", "tag": "06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:21.645596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eb66ff37-33bf-402c-8fd0-7743761a0717 req-e6801929-6240-4db1-ba53-470b0761859e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.646203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eb66ff37-33bf-402c-8fd0-7743761a0717 req-e6801929-6240-4db1-ba53-470b0761859e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.659536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-eb66ff37-33bf-402c-8fd0-7743761a0717 req-e6801929-6240-4db1-ba53-470b0761859e service nova] Creating event network-vif-deleted:06c0120b-43bf-42b7-a4b1-efc4f5fe8b0b for instance 599bf41f-04fc-42f6-8c4c-5946659a0fee on hv-cinder-84986 Jul 14 15:58:21.665244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-eb66ff37-33bf-402c-8fd0-7743761a0717 req-e6801929-6240-4db1-ba53-470b0761859e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 Jul 14 15:58:21.665838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 156/308] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:21.701998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:21.707408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0da50ee4-a555-4fbd-86c8-c42a817e1f28 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1515 microversion: 2.1 time: 0.266991 Jul 14 15:58:21.708557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 153/309] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:21 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:22.127797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:22.128650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:22.135913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.136437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.137474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.137943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.280932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.289787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c16e557-4d13-4405-bb83-3481c20755b1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.166635 Jul 14 15:58:22.290457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 157/310] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:22 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:22.398909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:22.399701 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:22.402486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:22.407891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.408391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.409162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.409600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.547674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.555240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b4241e66-552f-494a-9d21-2c26a4c71126 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.161283 Jul 14 15:58:22.555779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 154/311] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:22 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:22.725166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:22.725841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:22.732157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.732615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.733372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.733808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.797746 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.806025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a77c0a3d-72be-49df-a258-c4aabd422cac tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1350 microversion: 2.1 time: 0.084783 Jul 14 15:58:22.806865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 158/312] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:22 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:23.307886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:23.308656 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:23.316200 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.318268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.318268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.318268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.483259 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.491370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1b6c5133-c625-4703-b96c-6241cbc951f4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.188583 Jul 14 15:58:23.491970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 155/313] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:23 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:23.572019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:23.572654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:23.579176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.579603 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.580383 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.580815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.707056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.714714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7a8ee740-b47e-4aaa-8727-9c16ddc0d07e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1318 microversion: 2.1 time: 0.146631 Jul 14 15:58:23.715270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 159/314] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:23 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:23.823250 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:23.824080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:23.830543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.831088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.831881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.832356 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.900378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.908743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f0068bbb-5d03-451b-8449-9bbf377d9492 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1350 microversion: 2.1 time: 0.089442 Jul 14 15:58:23.909298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 156/315] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:23 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:24.509275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:24.509905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:24.516480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.516936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.517707 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.518148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.665181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.672681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-39b71bcc-1c71-449a-bd45-275a14a2f371 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.168171 Jul 14 15:58:24.673231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 160/316] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:24 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:24.731464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:24.732119 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:24.739214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.739682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.741609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.741609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.895521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.895521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab866435-1a90-4c0f-b719-a3e46378daef tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1501 microversion: 2.1 time: 0.167747 Jul 14 15:58:24.895768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 157/317] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:24 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:24.929317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:24.930054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:24.937089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.937690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.938645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.939256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.973001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.973501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.974033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lazy-loading 'fault' on Instance uuid 599bf41f-04fc-42f6-8c4c-5946659a0fee {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:25.023658 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d152595f433420f9cd0b7d45a4cb6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337009c5341c4de4a64823371566766c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:25.031638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-22a57da0-1d12-4f81-aa23-8503c6782c03 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 200 len: 1355 microversion: 2.1 time: 0.107483 Jul 14 15:58:25.032913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 161/318] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:24 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:25.690182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:25.691067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:25.697341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:25.697788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:25.698550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:25.698986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:25.843695 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:25.853051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f5713cd5-af1b-4753-9928-64d54ab6a358 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.166646 Jul 14 15:58:25.862827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 158/319] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:25 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:26.050429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:26.051077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:26.059333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.059783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.060878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.061319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.077620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] HTTP exception thrown: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Request method failure captured: Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee HTTP/1.1 Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvUXUhgvFXN2BfMUX627QhQuR9Qwnx_bnYcHfimIrHH5CB9oJemnEsRYs9g_R8sslb97Sfctii2n5olbDgTdYmgLP_Mc7Huz5ASSf28VXNpbwF5Hjz73GBM19VucW2Vbvh-ExLBKKPBoqr119GY6QfJpw_NjJzXlG50upSKF1fu9g Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:58:26.088501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/337009c5341c4de4a64823371566766c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_337009c5341c4de4a64823371566766c", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}] Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 9d152595f433420f9cd0b7d45a4cb6da Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:26.090697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '599bf41f-04fc-42f6-8c4c-5946659a0fee'} Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:26.092638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:26.094280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:26.095818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Returning 404 to user: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:26.095818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cfe6f80e-dbe0-43fc-b42a-2f4eef933e23 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 404 len: 111 microversion: 2.1 time: 0.044252 Jul 14 15:58:26.095818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 162/320] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:26 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:26.780091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:26.780625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:26.787052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.787501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.788299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.788733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.829072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:58:26.872255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:26.872853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:26.879069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.879521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.880317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.880828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.021261 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.028809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b9efce2c-e6ab-4ee9-ae5f-722af038e8b5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.160561 Jul 14 15:58:27.029374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 163/321] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:26 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:27.034074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:27.035014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:27.041623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.042077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.042845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.043284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.056639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] HTTP exception thrown: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Request method failure captured: Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee/os-volume_attachments HTTP/1.1 Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvUXUhgvFXN2BfMUX627QhQuR9Qwnx_bnYcHfimIrHH5CB9oJemnEsRYs9g_R8sslb97Sfctii2n5olbDgTdYmgLP_Mc7Huz5ASSf28VXNpbwF5Hjz73GBM19VucW2Vbvh-ExLBKKPBoqr119GY6QfJpw_NjJzXlG50upSKF1fu9g Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:58:27.058196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/337009c5341c4de4a64823371566766c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_337009c5341c4de4a64823371566766c", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}] Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 9d152595f433420f9cd0b7d45a4cb6da Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:27.059693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'server_id': '599bf41f-04fc-42f6-8c4c-5946659a0fee'} Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:27.060520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:27.061797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:27.063160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Returning 404 to user: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:27.063160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b1b6dab-bf70-44d6-b6ee-7da64ec6ad59 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029237 Jul 14 15:58:27.063160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 164/322] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 15:58:27 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:27.186282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c8e3f3a-fe8d-46da-b599-397c03e47a26 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "DELETE /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 204 len: 0 microversion: 2.1 time: 0.409785 Jul 14 15:58:27.186869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 159/323] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 15:58:26 2022] DELETE /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:58:27.195520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:27.197378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:27.202376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.202828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.203592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.204030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.338575 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.346106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f9cfe550-987f-45e0-a1e1-fe39cf7b3581 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1507 microversion: 2.1 time: 0.154923 Jul 14 15:58:27.346987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 165/324] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:27 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:28.046335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.047088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.054173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.054682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.055438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.055899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.060812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:28.188370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.195761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-90060b6c-e04e-4dd7-96de-6aef17011eda tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.153688 Jul 14 15:58:28.196462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 160/325] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:28 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:28.364168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.364774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.371344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.371854 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.372631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.373059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.516946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.525501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4a483cc-c254-4454-8e1e-1ac2fa6c4ba0 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1507 microversion: 2.1 time: 0.165187 Jul 14 15:58:28.526064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 166/326] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:28 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:28.708011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.708011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.715508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.715955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.716758 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.717195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.730723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] HTTP exception thrown: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Request method failure captured: Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee HTTP/1.1 Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvUXUhgvFXN2BfMUX627QhQuR9Qwnx_bnYcHfimIrHH5CB9oJemnEsRYs9g_R8sslb97Sfctii2n5olbDgTdYmgLP_Mc7Huz5ASSf28VXNpbwF5Hjz73GBM19VucW2Vbvh-ExLBKKPBoqr119GY6QfJpw_NjJzXlG50upSKF1fu9g Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:58:28.735350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/337009c5341c4de4a64823371566766c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_337009c5341c4de4a64823371566766c", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}] Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 9d152595f433420f9cd0b7d45a4cb6da Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.741763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '599bf41f-04fc-42f6-8c4c-5946659a0fee'} Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:28.742570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.743662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.744794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Returning 404 to user: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:28.744794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb6a445b-bfed-4731-bff7-692b4eaacf3c tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "DELETE /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 404 len: 111 microversion: 2.1 time: 0.034274 Jul 14 15:58:28.744794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 161/327] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 15:58:28 2022] DELETE /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:28.745818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.746427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] [instance: 599bf41f-04fc-42f6-8c4c-5946659a0fee] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.752479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.752924 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.753681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.754139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.768351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] HTTP exception thrown: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Request method failure captured: Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee HTTP/1.1 Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvUXUhgvFXN2BfMUX627QhQuR9Qwnx_bnYcHfimIrHH5CB9oJemnEsRYs9g_R8sslb97Sfctii2n5olbDgTdYmgLP_Mc7Huz5ASSf28VXNpbwF5Hjz73GBM19VucW2Vbvh-ExLBKKPBoqr119GY6QfJpw_NjJzXlG50upSKF1fu9g Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:58:28.769862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/337009c5341c4de4a64823371566766c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_337009c5341c4de4a64823371566766c", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/337009c5341c4de4a64823371566766c"}]}] Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 337009c5341c4de4a64823371566766c Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-1249436014 Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 9d152595f433420f9cd0b7d45a4cb6da Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-1249436014-project Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.771336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '599bf41f-04fc-42f6-8c4c-5946659a0fee'} Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:28.772873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. Jul 14 15:58:28.774178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:58:28.775380 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] Returning 404 to user: Instance 599bf41f-04fc-42f6-8c4c-5946659a0fee could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:28.775380 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-80416806-fe19-4ec4-b261-ec0506388556 tempest-DeleteServersTestJSON-1249436014 tempest-DeleteServersTestJSON-1249436014-project] 10.222.0.119 "GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee" status: 404 len: 111 microversion: 2.1 time: 0.029466 Jul 14 15:58:28.775980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 167/328] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:28 2022] GET /compute/v2.1/servers/599bf41f-04fc-42f6-8c4c-5946659a0fee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:29.213343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:29.213952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:29.220868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.221311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.222073 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.222507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.404712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.413847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68c655d7-a5c9-41c1-9b82-e031ac5a22c1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.204997 Jul 14 15:58:29.414704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 162/329] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:29 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:29.547911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:29.549265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:29.557413 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.558075 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.560038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.561161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.779426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.793816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e26d1225-8e07-4b3a-876b-f4d5bdc4ca22 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1507 microversion: 2.1 time: 0.248860 Jul 14 15:58:29.795794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 168/330] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:29 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:30.230575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-91b2f211-2e19-4232-b6c1-c2b136f145db req-e1d068a0-735e-4e72-af10-a3568b2c5347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2624ad70-f118-4407-b145-3e7c44efa22f", "name": "network-vif-deleted", "tag": "1c6c0b1b-7252-401d-8746-06437e0e74d5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:30.239475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-91b2f211-2e19-4232-b6c1-c2b136f145db req-e1d068a0-735e-4e72-af10-a3568b2c5347 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.240045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-91b2f211-2e19-4232-b6c1-c2b136f145db req-e1d068a0-735e-4e72-af10-a3568b2c5347 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.251872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-91b2f211-2e19-4232-b6c1-c2b136f145db req-e1d068a0-735e-4e72-af10-a3568b2c5347 service nova] Creating event network-vif-deleted:1c6c0b1b-7252-401d-8746-06437e0e74d5 for instance 2624ad70-f118-4407-b145-3e7c44efa22f on hv-cinder-84986 Jul 14 15:58:30.257871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-91b2f211-2e19-4232-b6c1-c2b136f145db req-e1d068a0-735e-4e72-af10-a3568b2c5347 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Jul 14 15:58:30.258718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 163/331] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:30.432628 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:30.433587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:30.442957 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.443630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.444484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.444951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.628618 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.638538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5dcae858-7858-4a79-bad1-e8533ef3c196 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.211037 Jul 14 15:58:30.639947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 169/332] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:30 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:30.813916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:30.815254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:30.825700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.826148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.826930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.827370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.905683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.918733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d1b8220-de7f-45c9-a784-22874e450f23 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1465 microversion: 2.1 time: 0.110398 Jul 14 15:58:30.920085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 164/333] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:30 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1465 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:31.656252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:31.656858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:31.664159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.664542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.666608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.667339 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.937167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:31.937867 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:31.945060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.945553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.946366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.946805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.979776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.980254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.980705 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lazy-loading 'fault' on Instance uuid 2624ad70-f118-4407-b145-3e7c44efa22f {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:32.114148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:32.124672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-153a0de8-b6c5-484e-a52a-4ecded2abd12 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1308 microversion: 2.1 time: 0.191280 Jul 14 15:58:32.125410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 165/334] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:31 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:32.249230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:32.257442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-058af70f-033c-46a7-8c49-e46221932667 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.605450 Jul 14 15:58:32.267083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 170/335] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:31 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:33.147961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:33.147961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:33.154485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.155825 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.157665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.158318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.218512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.219339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.219453 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lazy-loading 'fault' on Instance uuid 2624ad70-f118-4407-b145-3e7c44efa22f {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:33.275175 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:33.275798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:33.291744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.292412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.293712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.294412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.308274 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.318899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc59e005-1b31-4f04-9344-972f0c0aec3e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 200 len: 1308 microversion: 2.1 time: 0.179015 Jul 14 15:58:33.319436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 166/336] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:33 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:33.527471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.531007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:33.535401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1fd2ac7e-4588-4b2f-9f59-024a0d501852 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1526 microversion: 2.1 time: 0.264683 Jul 14 15:58:33.535979 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 171/337] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:33 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1526 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:34.342948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:34.343475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: 2624ad70-f118-4407-b145-3e7c44efa22f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:34.349456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.349905 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.350658 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.351089 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.363979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] HTTP exception thrown: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Request method failure captured: Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f HTTP/1.1 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D0EwxvvOa2CS_NPvPj_B5IQusYGb9IejBbUv-ggqWSqOxQ4DgRXlyIsN8TW8NrYSEMZpUocoNuUmgWJzRTZhQV5h6cFrzAPSIyOGPsS1a6kIM8dtHXjAaOLhTzIT75FKTsqVA7puQNF3qC7PL6LZIm5Y7CsIIUz2T4uCDDpBd9Jyt0 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: cbdae82cb97b48b7a541a22084bc111f Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesActionsTest-1236086322 Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:58:34.366138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cbdae82cb97b48b7a541a22084bc111f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cbdae82cb97b48b7a541a22084bc111f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cbdae82cb97b48b7a541a22084bc111f", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cbdae82cb97b48b7a541a22084bc111f"}]}] Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesActionsTest-1236086322 Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: cbdae82cb97b48b7a541a22084bc111f Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesActionsTest-1236086322 Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesActionsTest-1236086322-project Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 6a713d55889246049668bdb4e221c998 Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesActionsTest-1236086322-project Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. Jul 14 15:58:34.367599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '2624ad70-f118-4407-b145-3e7c44efa22f'} Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:34.368528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. Jul 14 15:58:34.370065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:34.371618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Returning 404 to user: Instance 2624ad70-f118-4407-b145-3e7c44efa22f could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:34.371618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fae3ee89-a043-4db5-a4be-9c2deff796a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f" status: 404 len: 111 microversion: 2.1 time: 0.028703 Jul 14 15:58:34.371618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 167/338] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:34 2022] GET /compute/v2.1/servers/2624ad70-f118-4407-b145-3e7c44efa22f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:34.500675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-29019638", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "networks": [{"uuid": "76d2fb51-b1c0-4365-a827-9ba97bef7a96"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:34.554537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:34.555164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:34.561257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.561714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.562494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.562934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.564420 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] validate_networks() for [('76d2fb51-b1c0-4365-a827-9ba97bef7a96', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:58:34.834677 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:34.844945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7f780288-8f66-4270-b2b2-372565193e3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1506 microversion: 2.1 time: 0.295504 Jul 14 15:58:34.846107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 168/339] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:34 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:34.871709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:34.871709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:34.877371 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.877835 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.878681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.879256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.150799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.154908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f154e17-34c3-4e8d-b8ec-00787495365d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1520 microversion: 2.1 time: 0.292347 Jul 14 15:58:35.156404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 169/340] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:34 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:35.174018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:58:35.174793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:58:35.175453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:58:35.175888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:58:35.176332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:58:35.192838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.194690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.195531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.198433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.215102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Getting quotas for project cbdae82cb97b48b7a541a22084bc111f. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:58:35.220024 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Getting quotas for user 6a713d55889246049668bdb4e221c998 and project cbdae82cb97b48b7a541a22084bc111f. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:58:35.231857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:58:35.234335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:58:35.608846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-72d8b6d7-a42e-464c-818b-53b290eeb620 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.114746 Jul 14 15:58:35.609535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 172/341] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:58:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 14 15:58:35.621598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-25fd3da2-77b4-4415-b52c-e9d3bcc5242a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:35.622308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-25fd3da2-77b4-4415-b52c-e9d3bcc5242a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:35.725066 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-25fd3da2-77b4-4415-b52c-e9d3bcc5242a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.741831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-25fd3da2-77b4-4415-b52c-e9d3bcc5242a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1216 microversion: 2.1 time: 0.124996 Jul 14 15:58:35.742858 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 170/342] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:35 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:36.760145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:36.760814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:36.768324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.768974 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.769916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.770557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.841854 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:36.849786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2279f7ab-da51-4ecd-8887-385398f363db tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1220 microversion: 2.1 time: 0.094993 Jul 14 15:58:36.850367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 173/343] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:36 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:37.866755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:37.867474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:37.874330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.874781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.875556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.875997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.940803 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:37.948525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-33d7d4b4-10cb-4999-a919-86c984cde663 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1220 microversion: 2.1 time: 0.085658 Jul 14 15:58:37.949082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 171/344] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:37 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:38.965892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:38.966570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:38.973271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.973723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:38.974507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.974937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:39.035140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:39.042487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0b8b26e-3f5c-40aa-b419-d33ef16312d2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1220 microversion: 2.1 time: 0.080870 Jul 14 15:58:39.043043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 174/345] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:38 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:40.059608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:40.060345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:40.066832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.067274 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.068039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.068498 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.143416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:40.151598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cbb1a962-0b6a-4f06-8c94-6aae680a8a6e tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1212 microversion: 2.1 time: 0.096340 Jul 14 15:58:40.151866 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 172/346] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:40 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:41.170118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:41.170659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:41.178289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.178737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.179668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.180810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.254359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:41.263133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1cc16525-2b5a-48ae-a708-c85b8ee63fbe tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1276 microversion: 2.1 time: 0.098507 Jul 14 15:58:41.263721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 175/347] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:41 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:41.342537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:41.346097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:41.353785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.357591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.358416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.361138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.392697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'flavor' on Instance uuid 5f9596a1-f8ec-4682-a980-392e550ebc33 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:41.775220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4120079a-74ba-42f5-9400-73c4e9393c1e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/action" status: 200 len: 32 microversion: 2.1 time: 0.437866 Jul 14 15:58:41.775849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 173/348] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 15:58:41 2022] POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:58:41.786477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:41.787535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:41.796382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.797139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.798351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.798939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.995758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.004632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc87c6c4-e101-4a84-95a3-f2b609189ffc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.222322 Jul 14 15:58:42.005382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 176/349] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:41 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:42.282499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:42.283201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:42.291278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.292091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.293586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.294198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.543812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.559309 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-463dc39e-284d-46ff-a1c1-58c2a08e492a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.280343 Jul 14 15:58:42.560464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 174/350] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:42 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:43.022828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:43.023745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:43.031070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.031851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.032974 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.033569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.199254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.206933 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0cf7784-9233-4bfb-bccf-4fbd32462687 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.188150 Jul 14 15:58:43.207496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 177/351] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:43 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:43.322278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-745c7867-5aa2-48e8-bb31-7f0d28207970 req-215b313f-5ae1-41d9-a58e-f7bb3a7fb52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8", "tag": "f8be29a0-e35d-4fcb-85e8-6291c4bd9b99"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:43.335411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-745c7867-5aa2-48e8-bb31-7f0d28207970 req-215b313f-5ae1-41d9-a58e-f7bb3a7fb52e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.335853 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-745c7867-5aa2-48e8-bb31-7f0d28207970 req-215b313f-5ae1-41d9-a58e-f7bb3a7fb52e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.349404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-745c7867-5aa2-48e8-bb31-7f0d28207970 req-215b313f-5ae1-41d9-a58e-f7bb3a7fb52e service nova] Creating event network-changed:f8be29a0-e35d-4fcb-85e8-6291c4bd9b99 for instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 on hv-cinder-84986 Jul 14 15:58:43.354577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-745c7867-5aa2-48e8-bb31-7f0d28207970 req-215b313f-5ae1-41d9-a58e-f7bb3a7fb52e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035995 Jul 14 15:58:43.355265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 175/352] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:43.577692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:43.578314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:43.584679 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.585135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.585905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.587107 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.770939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.779160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b9013cc-ee93-4751-b146-f073ab59979f tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.205444 Jul 14 15:58:43.779723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 178/353] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:43 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:44.227030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:44.227030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:44.233757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.234207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.235173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.235612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.376239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:44.384496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ffa38590-6b12-46fb-bf91-419b19b18f46 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.163674 Jul 14 15:58:44.385057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 176/354] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:44 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:44.796435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:44.796949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:44.805295 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.805897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.807270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.808130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.942431 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:44.950447 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69afc5c1-cf78-44b9-8087-5131ab7bce36 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.158382 Jul 14 15:58:44.951000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 179/355] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:44 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:45.401756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:45.402496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:45.408697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.409155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:45.409933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.410377 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:45.547556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:45.551275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:45.556970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ec8ebaa7-00c1-451a-8931-b84adb863fbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.159746 Jul 14 15:58:45.557623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 177/356] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:45 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:45.966978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:45.967592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:45.970720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:45.971411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:45.977487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.977942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:45.979005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.979244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.110475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.118998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad03c6b7-b4a4-46a4-ac36-43bab47cf5e7 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.155562 Jul 14 15:58:46.119736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 180/357] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:45 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:46.574553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:46.575163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:46.577423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:46.582589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.583039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.584069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.584532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.716667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.724007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f46a79e7-ec56-491c-ba0b-7fda2c68aa3c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.154027 Jul 14 15:58:46.724597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 178/358] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:46 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:47.135119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:47.135733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:47.142885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.143334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.144089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.144550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.277384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.285972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffbadb2b-a463-4776-849f-4c8be73d72f1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.155121 Jul 14 15:58:47.286554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 181/359] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:47 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:47.741898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:47.742809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:47.749357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.749806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.750567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.751033 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.881207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.889155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d091e8fe-de79-452c-80e1-f6e372badba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.151185 Jul 14 15:58:47.889773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 179/360] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:47 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:48.308497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:48.310109 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:48.315432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.315877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.316668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.317104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.451929 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:48.459263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5de3eb8-cd0f-402c-bee1-d1ebe41c8030 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.155060 Jul 14 15:58:48.459889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 182/361] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:48 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:48.905988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:48.906593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:48.912721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.913170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.913939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.916538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.048438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.056598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-25098ef2-2b97-4a08-9208-1273cb5b370d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.154497 Jul 14 15:58:49.057168 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 180/362] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:48 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:49.475742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:49.476378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:49.483883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:49.484361 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.485133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:49.485581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.616328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.623776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18d7d978-27fa-4ec8-8993-336e13b639ae tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.151974 Jul 14 15:58:49.624394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 183/363] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:49 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:50.074873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:50.075475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:50.087454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.087911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.088709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.089182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.228750 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.238166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c467392b-2474-4534-85bb-8347a7c613de tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.168381 Jul 14 15:58:50.238733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 181/364] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:50 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:50.640762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:50.644840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:50.647549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.647994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.648835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.649592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.788919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.796702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-573f0f10-15cd-40e8-adab-1e3a49ad26b1 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.159813 Jul 14 15:58:50.797209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 184/365] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:50 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:51.254844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:51.255582 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:51.261742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.262251 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.263025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.263649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.640821 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:51.648293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e4b0d7ed-bcf2-465d-b662-58e3c39c3eb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.397320 Jul 14 15:58:51.649941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 182/366] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:51 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:51.813141 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:51.813764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:51.817177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:51.820815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.822136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.822795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.823238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.954489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:51.963160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a98e8262-6f4b-4190-9917-1e7fc61188b2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.153968 Jul 14 15:58:51.963731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 185/367] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:51 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:52.674413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:52.674413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:52.677134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:52.678060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:52.679028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:52.679622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:52.826550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:52.834294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9dc25a64-3073-430e-b1f6-0ae01bc95dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.171159 Jul 14 15:58:52.835191 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 183/368] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:52 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:52.981402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:52.982118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:52.989740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:52.990509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:52.991308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:52.991751 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:53.127426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:53.145416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-874de6af-891f-4b59-8fc0-a09e6829baf8 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.168590 Jul 14 15:58:53.145994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 186/369] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:52 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:53.852747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:53.853370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:53.855417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:53.860153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:53.860612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:53.861385 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:53.861824 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.002721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:54.012117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02248d96-e966-406d-8c6b-326320edefd0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.163765 Jul 14 15:58:54.012700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 184/370] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:53 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:54.163414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:54.164726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:54.171312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:54.173394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.173394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:54.173394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.303810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:54.311836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-970c4bf0-12ba-4414-a2ed-60bcfde10cb3 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.152625 Jul 14 15:58:54.312500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 187/371] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:54 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:54.886555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-2353e19f-ab46-4586-ae49-126a1a73085d req-8da31983-f1e9-4868-b9d3-046e67bdb2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8", "name": "network-vif-plugged", "status": "completed", "tag": "f8be29a0-e35d-4fcb-85e8-6291c4bd9b99"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:54.894914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-2353e19f-ab46-4586-ae49-126a1a73085d req-8da31983-f1e9-4868-b9d3-046e67bdb2be service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:54.895352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-2353e19f-ab46-4586-ae49-126a1a73085d req-8da31983-f1e9-4868-b9d3-046e67bdb2be service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.907002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-2353e19f-ab46-4586-ae49-126a1a73085d req-8da31983-f1e9-4868-b9d3-046e67bdb2be service nova] Creating event network-vif-plugged:f8be29a0-e35d-4fcb-85e8-6291c4bd9b99 for instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 on hv-cinder-84986 Jul 14 15:58:54.911887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-2353e19f-ab46-4586-ae49-126a1a73085d req-8da31983-f1e9-4868-b9d3-046e67bdb2be service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028919 Jul 14 15:58:54.912507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 185/372] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:55.031446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:55.032064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:55.038359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:55.038810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:55.039599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:55.040047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:55.184388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:55.191812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a833ccd8-d0a4-41b6-bcb5-fdf099675e96 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.166843 Jul 14 15:58:55.192401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 188/373] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:55 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:55.329247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:55.329946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:55.336496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:55.336958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:55.337715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:55.338145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:55.534953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:55.542923 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7073aea6-5077-4147-a575-9e3fcbe33a1a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.217818 Jul 14 15:58:55.543539 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 186/374] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:55 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:56.209734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:56.210342 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:56.217430 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.223635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.223635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.223635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.223635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:56.358250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:56.365724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62595ad2-90a8-490d-84bc-a325248041c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.160192 Jul 14 15:58:56.366283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 189/375] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:56 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:56.560550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:56.561170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:56.567282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.567735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.568529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.568962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.735356 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:56.743898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f093354c-7ada-4749-90e3-63681a43a3a2 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.187326 Jul 14 15:58:56.744735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 187/376] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:56 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:57.382901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:57.383659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:57.389786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.390571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.391347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.391787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.533718 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:57.541769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a34313b5-a40d-42ca-a5bf-aa16fc5b1b1f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.162878 Jul 14 15:58:57.542342 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 190/377] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:57 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:57.761258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:57.761772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:57.767756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.768241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.768998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.769426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.923527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:57.932663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-abe9b3f3-299b-48bd-a81d-89faf7ab4d19 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.175189 Jul 14 15:58:57.933312 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 188/378] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:57 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:58.559229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:58.559949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:58.567159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.567522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.569460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.569460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.741626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:58.752598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aaa6b65f-5198-41ec-b8c3-faf51ba52a66 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.197004 Jul 14 15:58:58.752598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 191/379] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:58 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:58.771841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc39cbf2-a593-4047-a3bb-0ff0a6a3e9cc"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:58.772992 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:58.779843 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.780334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.781100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.781539 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.806399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] HTTP exception thrown: Cannot 'attach_volume' instance 5f9596a1-f8ec-4682-a980-392e550ebc33 while it is in vm_state rescued Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Request method failure captured: Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/os-volume_attachments HTTP/1.1 Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 74 Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvIzNluMjDp4d3DT5QnvYlw7pRmop_TCGkbaYTQiG5SxYVEGSYRm0dhjXXOMfnm61qx9mJxERTKeTRsuliirCltEJ6xQiwu_JdJxnN2xoKgc1SV0WzqvRAmVBQR9GNIOwARxvOu71BmMHSM1575bPlVIAEYo0-7gIauEqjsC3ZS_o Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 15:58:58.808087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_2604fe90997b48439ed17360fa15f24a", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}] Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: fe6f58bedd87454bad46b0c48697eec9 Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {"volumeAttachment": {"volumeId": "fc39cbf2-a593-4047-a3bb-0ff0a6a3e9cc"}} Jul 14 15:58:58.822366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Cannot 'attach_volume' instance 5f9596a1-f8ec-4682-a980-392e550ebc33 while it is in vm_state rescued Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'server_id': '5f9596a1-f8ec-4682-a980-392e550ebc33', 'body': {'volumeAttachment': {'volumeId': 'fc39cbf2-a593-4047-a3bb-0ff0a6a3e9cc'}}} Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:58.823156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5f9596a1-f8ec-4682-a980-392e550ebc33 while it is in vm_state rescued Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:58.824425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5f9596a1-f8ec-4682-a980-392e550ebc33 while it is in vm_state rescued Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Returning 409 to user: Cannot 'attach_volume' instance 5f9596a1-f8ec-4682-a980-392e550ebc33 while it is in vm_state rescued {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41a152ec-8f33-45ce-8150-658053786763 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042386 Jul 14 15:58:58.825676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 189/380] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 15:58:58 2022] POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 15:58:58.826193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:58.826193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:58.843769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.844351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.845038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.845648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.950763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:58.951461 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:58.958652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.959716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.960609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.961045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.139536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:59.142186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-067507e0-a758-480f-bd30-d0ef09b88bdc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/action" status: 202 len: 0 microversion: 2.1 time: 0.325698 Jul 14 15:58:59.143726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 192/381] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 15:58:58 2022] POST /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:58:59.149812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2ef42044-2498-4019-9360-bcba8822b9ff tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1316 microversion: 2.1 time: 0.203009 Jul 14 15:58:59.152169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 190/382] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:58 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:59.155175 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.156021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.162989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.163438 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.164236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.164676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.299180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:59.307152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff6a478d-9851-4228-8ea0-6925f30cf243 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1514 microversion: 2.1 time: 0.157887 Jul 14 15:58:59.308040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 193/383] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:58:59 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:00.168699 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:00.170556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:00.182597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.186548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.187933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.188639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.327288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:00.327288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:00.368410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.368410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.368410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.368410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.382848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:00.394436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a986e33e-2506-42c3-9f85-d6ce1aceced6 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1500 microversion: 2.1 time: 0.230951 Jul 14 15:59:00.395752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 191/384] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:00 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:00.547743 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:00.558297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7028b618-f887-4061-abb8-c0b2806686e1 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1514 microversion: 2.1 time: 0.237550 Jul 14 15:59:00.559087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 194/385] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:00 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:01.576698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:01.577330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:01.583469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.584232 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:01.585021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.585452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:01.719872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:01.728305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20f0cdce-1988-4673-9b23-5afcf47136fc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1514 microversion: 2.1 time: 0.155259 Jul 14 15:59:01.728893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 192/386] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:01 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:01.977948 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:01.978474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:01.985005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.985621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:01.986403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.986846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.012525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:59:02.369702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1296b407-3366-4b43-b66e-41d541e9eb9d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "DELETE /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 204 len: 0 microversion: 2.1 time: 0.395961 Jul 14 15:59:02.370296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 195/387] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 15:59:01 2022] DELETE /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:59:02.378425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:02.379042 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:02.385115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:02.385569 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.386338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:02.386774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.552678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:02.552678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bff2aa6-5035-4fef-ad3e-0601b958b7be tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1506 microversion: 2.1 time: 0.174105 Jul 14 15:59:02.552678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 193/388] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:02 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:02.745946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:02.746574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:02.752580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:02.753124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.753853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:02.754294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.910436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:02.918595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4328f961-7dc6-4749-a05a-b0744cab8e2b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1514 microversion: 2.1 time: 0.176998 Jul 14 15:59:02.919179 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 196/389] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:02 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:03.567067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:03.569873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:03.574246 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.574780 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:03.575461 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.575897 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:03.723725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:03.732192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0c42fc2-af37-4334-98b4-62990957971a tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1506 microversion: 2.1 time: 0.169226 Jul 14 15:59:03.732785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 194/390] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:03 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:03.935682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:03.936344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:03.942899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.943347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:03.944126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.944570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.075676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:04.088571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff538e2a-cfc7-4771-9d96-bd7fb0d002fb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1514 microversion: 2.1 time: 0.156575 Jul 14 15:59:04.089151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 197/391] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:03 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:04.749846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:04.750462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:04.756628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:04.757077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.757841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:04.758448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.777314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:04.900383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:04.907944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb0bd2a6-1189-4baf-b408-1dfd69485a78 tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1506 microversion: 2.1 time: 0.161917 Jul 14 15:59:04.908864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 195/392] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:04 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:05.107896 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:05.108846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:05.115997 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.116641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:05.117934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.118500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:05.310314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:05.318239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9ba620d-69e2-4a7e-8718-0582264ed57d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1520 microversion: 2.1 time: 0.216510 Jul 14 15:59:05.319000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 198/393] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:05 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:05.928898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:05.930239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:05.937754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.938376 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:05.939347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.939926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:06.173510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:06.182766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01ebeb32-d7cf-4856-9397-620ae8f7ae1c tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1506 microversion: 2.1 time: 0.259154 Jul 14 15:59:06.192959 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 196/394] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:05 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:06.421442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e53e99d8-392e-4c1b-9f4e-619137b2729b req-f5ad229e-7235-49ec-a690-6c6b4d1b0ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8", "name": "network-vif-deleted", "tag": "f8be29a0-e35d-4fcb-85e8-6291c4bd9b99"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:06.430392 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e53e99d8-392e-4c1b-9f4e-619137b2729b req-f5ad229e-7235-49ec-a690-6c6b4d1b0ae3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:06.431135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e53e99d8-392e-4c1b-9f4e-619137b2729b req-f5ad229e-7235-49ec-a690-6c6b4d1b0ae3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:06.443341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e53e99d8-392e-4c1b-9f4e-619137b2729b req-f5ad229e-7235-49ec-a690-6c6b4d1b0ae3 service nova] Creating event network-vif-deleted:f8be29a0-e35d-4fcb-85e8-6291c4bd9b99 for instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 on hv-cinder-84986 Jul 14 15:59:06.449379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e53e99d8-392e-4c1b-9f4e-619137b2729b req-f5ad229e-7235-49ec-a690-6c6b4d1b0ae3 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031378 Jul 14 15:59:06.450340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 199/395] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:07.200789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:07.201409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:07.207473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:07.207921 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:07.208718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:07.209409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:07.241604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:07.242052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:07.242525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lazy-loading 'fault' on Instance uuid cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:07.290060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a713d55889246049668bdb4e221c998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbdae82cb97b48b7a541a22084bc111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:07.302640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3127b48e-f17e-43d3-bf01-b51872d2a7bd tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 200 len: 1306 microversion: 2.1 time: 0.102434 Jul 14 15:59:07.302640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 197/396] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:07 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:08.324456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:08.326135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] [instance: cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:08.333355 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:08.333683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:08.334915 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:08.335514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:08.351931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] HTTP exception thrown: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Request method failure captured: Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 HTTP/1.1 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D0EwxvvOa2CS_NPvPj_B5IQusYGb9IejBbUv-ggqWSqOxQ4DgRXlyIsN8TW8NrYSEMZpUocoNuUmgWJzRTZhQV5h6cFrzAPSIyOGPsS1a6kIM8dtHXjAaOLhTzIT75FKTsqVA7puQNF3qC7PL6LZIm5Y7CsIIUz2T4uCDDpBd9Jyt0 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: cbdae82cb97b48b7a541a22084bc111f Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesActionsTest-1236086322 Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 15:59:08.354322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cbdae82cb97b48b7a541a22084bc111f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cbdae82cb97b48b7a541a22084bc111f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cbdae82cb97b48b7a541a22084bc111f", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cbdae82cb97b48b7a541a22084bc111f"}]}] Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesActionsTest-1236086322 Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: cbdae82cb97b48b7a541a22084bc111f Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesActionsTest-1236086322 Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesActionsTest-1236086322-project Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 6a713d55889246049668bdb4e221c998 Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesActionsTest-1236086322-project Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. Jul 14 15:59:08.355752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8'} Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:08.356487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. Jul 14 15:59:08.357613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 15:59:08.359987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] Returning 404 to user: Instance cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:08.359987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0edcd204-b5ea-4b9c-ae87-614718243e1d tempest-VolumesActionsTest-1236086322 tempest-VolumesActionsTest-1236086322-project] 10.222.0.119 "GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8" status: 404 len: 111 microversion: 2.1 time: 0.041738 Jul 14 15:59:08.359987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 200/397] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:08 2022] GET /compute/v2.1/servers/cb4a1b16-d2c7-41d6-8544-f7ffa4ddf2b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:08.477198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8a3fa85-9c9e-4c64-a486-1e5fc428f64b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: .version_select at 0x7f0dc1f60c10>, body: {"keypair": {"name": "tempest-keypair-892830047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI79sGnq040Qy6l9hamMmMfKcTVvaHfixKvJ1NYsGKLN/95OC7rp2OD3WNxN/jPn8umMKAs/nBXzRaoSSr4B8JthY5KFe3Z5ueqoLFe7rHhcBeCrzTjceFHr5OATaS76g=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:08.494828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e8a3fa85-9c9e-4c64-a486-1e5fc428f64b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for project 2604fe90997b48439ed17360fa15f24a. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:08.499554 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e8a3fa85-9c9e-4c64-a486-1e5fc428f64b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for user fe6f58bedd87454bad46b0c48697eec9 and project 2604fe90997b48439ed17360fa15f24a. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:08.663773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e8a3fa85-9c9e-4c64-a486-1e5fc428f64b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190910 Jul 14 15:59:08.665096 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 198/398] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 15:59:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:12.665887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-596286274", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2a008ce-b413-4a5d-9bd5-9c77d32d3f2c"}], "security_groups": [{"name": "tempest-securitygroup--691774767"}], "key_name": "tempest-keypair-892830047", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:12.780785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] validate_networks() for [('f2a008ce-b413-4a5d-9bd5-9c77d32d3f2c', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:13.334833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:13.335464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:13.336093 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:13.337344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:13.337912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:13.348586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:13.355667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:13.368702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:13.371012 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:13.402291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:13.407240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Getting quotas for user fe6f58bedd87454bad46b0c48697eec9 and project 2604fe90997b48439ed17360fa15f24a. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:13.421688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:13.424701 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:13.775857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d26c5f8c-f6f6-480a-9191-c07d891bd6d0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.115622 Jul 14 15:59:13.777590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 201/399] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:59:12 2022] POST /compute/v2.1/servers => generated 410 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:59:13.791404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c2f5320-e846-427f-9812-08fdabb75c7c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:13.793199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c2f5320-e846-427f-9812-08fdabb75c7c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:13.903641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c2f5320-e846-427f-9812-08fdabb75c7c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:13.913102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c2f5320-e846-427f-9812-08fdabb75c7c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1248 microversion: 2.1 time: 0.129001 Jul 14 15:59:13.928417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 199/400] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:13 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:14.938902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-becf700e-a2a1-4955-ab2f-f60fc29fb96c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:14.939596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-becf700e-a2a1-4955-ab2f-f60fc29fb96c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:15.020602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-becf700e-a2a1-4955-ab2f-f60fc29fb96c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:15.035818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-becf700e-a2a1-4955-ab2f-f60fc29fb96c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1248 microversion: 2.1 time: 0.100843 Jul 14 15:59:15.044194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 202/401] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:14 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:16.053280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:16.053886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:16.062864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:16.063317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:16.064144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:16.067702 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:16.137030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:16.146504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-34465faf-1f11-4b85-ab34-673897f83f12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1252 microversion: 2.1 time: 0.097256 Jul 14 15:59:16.147611 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 200/402] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:16 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:17.166207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:17.167510 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:17.175547 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:17.176333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:17.178302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:17.178972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:17.276659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:17.284484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d6693e04-2e17-4892-a0eb-18063722e0ad tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1252 microversion: 2.1 time: 0.123184 Jul 14 15:59:17.288140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 203/403] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:17 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1252 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:18.302151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:18.302925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:18.311856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:18.312686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:18.313975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:18.314790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:18.389591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:18.398598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e4daee06-be2d-4258-9685-7e79650c6dd3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1300 microversion: 2.1 time: 0.101297 Jul 14 15:59:18.399397 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 201/404] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:18 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:19.417582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:19.418851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:19.433413 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.434903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:19.437804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.438822 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:19.726521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:19.754775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5d4b6ea4-562e-470d-9ed0-a4ac4e534e24 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1308 microversion: 2.1 time: 0.342335 Jul 14 15:59:19.755844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 204/405] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:19 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:20.775393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:20.776804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:20.785037 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:20.785714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:20.791517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:20.791517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.158910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:21.169484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d01224e-36f7-4e75-9cbc-7760a35853ce tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.400273 Jul 14 15:59:21.172937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 202/406] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:20 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:22.210733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:22.211960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:22.228497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.229403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.230346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.230785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.859249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:22.875761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b2707b3c-1387-4ef5-bff9-ad8b8f358e7d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.663580 Jul 14 15:59:22.887879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 205/407] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:22 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:23.142338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-cce1fd0a-ef9b-4114-9f2f-e888f5459889 req-7daae40b-ab50-4d65-aa18-bf5a2c838545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:23.163776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-cce1fd0a-ef9b-4114-9f2f-e888f5459889 req-7daae40b-ab50-4d65-aa18-bf5a2c838545 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.165316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-cce1fd0a-ef9b-4114-9f2f-e888f5459889 req-7daae40b-ab50-4d65-aa18-bf5a2c838545 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.197945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-cce1fd0a-ef9b-4114-9f2f-e888f5459889 req-7daae40b-ab50-4d65-aa18-bf5a2c838545 service nova] Creating event network-changed:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 15:59:23.212016 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-cce1fd0a-ef9b-4114-9f2f-e888f5459889 req-7daae40b-ab50-4d65-aa18-bf5a2c838545 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069093 Jul 14 15:59:23.213167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 203/408] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:23.897785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:23.899771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:23.917798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:23.918943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.921616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.923911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.924461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.943411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:24.346444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:24.363530 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f66300a5-02ac-4a1a-bf47-50a9698d2ccc tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.471933 Jul 14 15:59:24.364167 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 206/409] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:23 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:25.378870 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:25.401295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:25.401295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:25.401295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:25.401295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.401931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.401931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.401931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.574280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:25.584133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-92be36a7-ebbc-4657-b62c-29f57ae3dd85 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.205983 Jul 14 15:59:25.585540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 204/410] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:25 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:26.603266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:26.604606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:26.614308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:26.615003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:26.617359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.620741 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.621571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.622016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.834004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:26.846906 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4cf79fba-b341-4c84-9fe7-5539389cfba3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.248076 Jul 14 15:59:26.848995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 207/411] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:26 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:27.868936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:27.869707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:27.894415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.894415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:27.894415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.894415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.175821 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:28.205439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b153805-01c6-4ca1-bf75-e71eefa7f147 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.332664 Jul 14 15:59:28.205439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 205/412] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:27 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:29.211150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:29.213659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:29.228646 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:29.236785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:29.251787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:29.251787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:29.912373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:29.919754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8743304f-c51d-482d-ac64-0b609b51628c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.712705 Jul 14 15:59:29.920377 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 208/413] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:29 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:30.937722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:30.938935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:30.950244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.952360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:30.952360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.952360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.385273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:31.403138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02b37672-856d-479f-8010-80c18c4a1bc6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.467160 Jul 14 15:59:31.404345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 206/414] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:30 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:32.422301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:32.423065 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:32.442375 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.447591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.448971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.449517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.749796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:32.762546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8d90856-2ac6-425f-b078-99175b7c2b54 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.346385 Jul 14 15:59:32.763779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 209/415] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:32 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:33.784842 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:33.786271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:33.798837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.799815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.802843 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.803698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.842089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-feec7ab1-686f-48d0-9a67-d2c0a9cc04b0 req-c4ea8287-b696-4e0e-b692-b3a2a8fd1694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "name": "network-vif-plugged", "status": "completed", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:33.866653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-feec7ab1-686f-48d0-9a67-d2c0a9cc04b0 req-c4ea8287-b696-4e0e-b692-b3a2a8fd1694 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.872362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-feec7ab1-686f-48d0-9a67-d2c0a9cc04b0 req-c4ea8287-b696-4e0e-b692-b3a2a8fd1694 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.906124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-feec7ab1-686f-48d0-9a67-d2c0a9cc04b0 req-c4ea8287-b696-4e0e-b692-b3a2a8fd1694 service nova] Creating event network-vif-plugged:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 15:59:33.911950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-feec7ab1-686f-48d0-9a67-d2c0a9cc04b0 req-c4ea8287-b696-4e0e-b692-b3a2a8fd1694 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073597 Jul 14 15:59:33.913426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 210/416] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:34.181441 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:34.194426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b19d7a79-6aa7-40a0-a5a1-39523f9baa12 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.413558 Jul 14 15:59:34.195036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 207/417] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:33 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:35.224501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:35.225196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:35.232414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.241468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.241468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.241468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.410221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:35.427855 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a8834e5-5b48-4c14-889c-a315a5ed5535 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.207685 Jul 14 15:59:35.440877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 211/418] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:35 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:36.447683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:36.448555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:36.455998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.456640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.459265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.460212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.467667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=61 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:36.556168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'create', calling method: .version_select at 0x7f0dc1f89790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-591744031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBl7Z8lGHhLMmXpe/tbAihgjBbXC9q99VBUbTdQMka2tj3xum8v3Zn7TSt1JICE8pgtBwO7HNoNCePqWJqwIroS0oLyabsuTJFH8wFTO9n1UloIBMZVOAckJ2sxZz088A=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:36.583034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Getting quotas for project cffc3cae7b014c62b9b58207cb7ef3aa. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:36.595183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Getting quotas for user aad6767795b0402cb72f249b4c3a8039 and project cffc3cae7b014c62b9b58207cb7ef3aa. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:36.614623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [a93f9d2b-adb5-435f-a44a-f5505f9f97c3] AMQP server on 10.222.0.119:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:59:36.651841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:36.661369 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2b5f001-c695-4a80-9fd8-a17d3eab5712 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.218517 Jul 14 15:59:36.662442 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 208/419] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:36 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:37.627122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [a93f9d2b-adb5-435f-a44a-f5505f9f97c3] Reconnected to AMQP server on 10.222.0.119:5672 via [amqp] client with port 34930. Jul 14 15:59:37.681204 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:37.682659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:37.691640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:37.692464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:37.693724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:37.694311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:37.708925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54baeab6-b0e8-4c36-8887-c0094078bb2a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.157735 Jul 14 15:59:37.710160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 212/420] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 15:59:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:37.859444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-913570087", "imageRef": "06bf2230-145b-4c90-af4a-5bc01389150a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-591744031", "networks": [{"uuid": "c9a5251c-11e1-4913-be3c-2c9cbf664c35"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:37.934554 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:37.942760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c2282c4-d48a-45e3-a1bb-c61963e2aa87 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.268099 Jul 14 15:59:37.943332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 209/421] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:37 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:37.943986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] validate_networks() for [('c9a5251c-11e1-4913-be3c-2c9cbf664c35', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:38.349748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:38.350207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:38.350915 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:38.351324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:38.351772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:38.361738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.362503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.363517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.364175 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.383945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Getting quotas for project cffc3cae7b014c62b9b58207cb7ef3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:38.388263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Getting quotas for user aad6767795b0402cb72f249b4c3a8039 and project cffc3cae7b014c62b9b58207cb7ef3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:38.413936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:38.419188 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06bf2230-145b-4c90-af4a-5bc01389150a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:38.711723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef4374d5-8eb3-4f66-9a06-1167bba88664 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.855950 Jul 14 15:59:38.713833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 213/422] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:59:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:59:38.724946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-03440038-1156-4df4-8fbc-a3a4ebf66c11 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:38.726246 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-03440038-1156-4df4-8fbc-a3a4ebf66c11 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:38.819735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03440038-1156-4df4-8fbc-a3a4ebf66c11 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:38.826747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-03440038-1156-4df4-8fbc-a3a4ebf66c11 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1261 microversion: 2.1 time: 0.106845 Jul 14 15:59:38.827489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 210/423] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:38 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:38.959974 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:38.960626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:38.967059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.967511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.968315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.968753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.106616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:39.114081 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1dc842b1-7472-4c07-95d5-f3474649aa65 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1373 microversion: 2.1 time: 0.158171 Jul 14 15:59:39.114648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 214/424] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:38 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:39.845961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dea5adc6-2aa5-441e-b8a1-911a26b97597 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:39.847020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dea5adc6-2aa5-441e-b8a1-911a26b97597 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:39.940282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dea5adc6-2aa5-441e-b8a1-911a26b97597 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:39.953252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dea5adc6-2aa5-441e-b8a1-911a26b97597 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1261 microversion: 2.1 time: 0.112197 Jul 14 15:59:39.954836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 211/425] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:39 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:40.131691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:40.132315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:40.140636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.141332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:40.142288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.142888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:40.320600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:40.331305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9680f71a-81c1-423c-9ddc-1f803932a0e0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1567 microversion: 2.1 time: 0.203657 Jul 14 15:59:40.332113 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 215/426] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:40 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:40.349882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:40.353335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:40.357738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.358408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:40.359367 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.359816 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:40.458902 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87769bab-3289-4659-8198-1faec46d4032 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112835 Jul 14 15:59:40.459958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 212/427] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 15:59:40 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:40.979978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:40.981461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:40.988972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.989762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:40.990734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:40.991438 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.062267 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:41.075387 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3be499cf-6451-47b4-bd41-42766dbdf78e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1265 microversion: 2.1 time: 0.108423 Jul 14 15:59:41.076437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 216/428] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:40 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:41.801759 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-c5cdc135-b4c6-4e56-9beb-64d63522d0f6 req-48c2f54e-f7d2-4c3c-9460-e7ae530d8134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:41.819121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c5cdc135-b4c6-4e56-9beb-64d63522d0f6 req-48c2f54e-f7d2-4c3c-9460-e7ae530d8134 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.822498 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c5cdc135-b4c6-4e56-9beb-64d63522d0f6 req-48c2f54e-f7d2-4c3c-9460-e7ae530d8134 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.846981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-c5cdc135-b4c6-4e56-9beb-64d63522d0f6 req-48c2f54e-f7d2-4c3c-9460-e7ae530d8134 service nova] Creating event network-changed:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 15:59:41.853239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-c5cdc135-b4c6-4e56-9beb-64d63522d0f6 req-48c2f54e-f7d2-4c3c-9460-e7ae530d8134 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056857 Jul 14 15:59:41.854558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 213/429] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:42.093818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.094651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.109098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.109560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.110428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.110878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.260476 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.260476 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-821b9020-1cb3-4b91-bc7a-5f735f1cbb9d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1313 microversion: 2.1 time: 0.144786 Jul 14 15:59:42.260476 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 217/430] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:43.255007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.256681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.267739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.269900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.269900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.269900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.402592 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.411305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01f70dbd-2e07-4fb4-ba4b-e46e751e1aa7 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1331 microversion: 2.1 time: 0.161117 Jul 14 15:59:43.413275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 214/431] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:44.430897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:44.432712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:44.452901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.452901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.452901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.452901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.616207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.625524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-432443e2-7a1a-46b2-b36a-3795c9b6f37f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.199472 Jul 14 15:59:44.626137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 218/432] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.356350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-9d84644a-cb3e-4cea-8206-3705c927cd97 req-a0725f94-96d4-4929-958a-2c893be7b6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:45.367797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9d84644a-cb3e-4cea-8206-3705c927cd97 req-a0725f94-96d4-4929-958a-2c893be7b6ad service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.368582 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9d84644a-cb3e-4cea-8206-3705c927cd97 req-a0725f94-96d4-4929-958a-2c893be7b6ad service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.384646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-9d84644a-cb3e-4cea-8206-3705c927cd97 req-a0725f94-96d4-4929-958a-2c893be7b6ad service nova] Creating event network-changed:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 15:59:45.389605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-9d84644a-cb3e-4cea-8206-3705c927cd97 req-a0725f94-96d4-4929-958a-2c893be7b6ad service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038718 Jul 14 15:59:45.390210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 215/433] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:45.643013 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.643637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.650660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.651126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.652209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.652655 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.850835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.859616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15465474-a42b-4c9f-b1d2-431c2653a5cb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.220596 Jul 14 15:59:45.860222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 219/434] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:46.878631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.879332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:46.887036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.887577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.888389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.888833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.046149 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:47.060779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0b10074-16e2-4e54-9f80-5c044003fcc2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.185124 Jul 14 15:59:47.060779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 216/435] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:48.076975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.077990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.084216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.084977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.085711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.086164 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.275585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:48.283639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-07950eca-fbc6-45f1-a45d-b5e13b2c96e6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.210480 Jul 14 15:59:48.304527 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 220/436] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:49.317156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.318686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.327782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.328841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.330081 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.330861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.498807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.506239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b43556b3-330d-48b8-a258-692437688608 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.196911 Jul 14 15:59:49.506815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 217/437] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:50.525491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.526097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.532525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:50.532525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=10 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:50.534892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.535337 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.536124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.536574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.735876 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.745115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6825ee9-a800-41d4-8b14-f2f9f137f26c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.223713 Jul 14 15:59:50.745793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 221/438] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:51.763392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.764162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.766940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:51.772741 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.773255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.774715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.775440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.922345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:51.930048 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-98218e9a-9c30-4bf1-9fce-7dc17ec9d274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.171916 Jul 14 15:59:51.930655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 218/439] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:52.112633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.112633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.125302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.125873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.126847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.127289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.158656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-209436c7-7188-459c-8eae-398d7f71d574 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/ips" status: 200 len: 146 microversion: 2.1 time: 0.052228 Jul 14 15:59:52.160564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 222/440] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:52.949396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.950197 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.956599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.957056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.957830 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.958268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.110011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:53.119325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6de52915-41f0-4891-8510-f781849d5d9e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.174662 Jul 14 15:59:53.120072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 219/441] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:54.138425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:54.140302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:54.148157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.150497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.150497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.150835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.313094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.354699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0949494e-e5e2-43f1-b613-fe316f47db3c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.188445 Jul 14 15:59:54.354699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 223/442] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:54 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:55.340523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.341145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.347126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.347575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.348364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.348793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.489098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.498060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-240696d4-4643-40e1-be20-2c64a10aa9c8 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.162181 Jul 14 15:59:55.499102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 220/443] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.518968 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.533802 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.544445 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.544889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.545694 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.546226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.679798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.688513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1c460ab8-9e9b-4756-850f-945df0dfa35f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.175910 Jul 14 15:59:56.689094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 224/444] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:57.153091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.153636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.160230 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.160721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.161489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.161925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.186552 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab15556d-ff06-425f-ba9c-ace8762399cb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/ips" status: 200 len: 149 microversion: 2.1 time: 0.037329 Jul 14 15:59:57.187429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 221/445] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:57.236312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2052788683", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:57.300224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] validate_networks() for None {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:57.707699 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.708530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.719025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.719375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.720198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.727035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.946338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:57.947140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:57.947661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:57.948172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:57.948832 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:57.966351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.968357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.968501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.968875 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.977801 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.994414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Getting quotas for project 976bae50af4d476b9195b2006bd707fb. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:57.997796 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8723114-c8de-4014-b46d-2e77855b8eb4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.294868 Jul 14 15:59:57.998633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Getting quotas for user fc90ff5846f6412c9a36a3f66fdc403c and project 976bae50af4d476b9195b2006bd707fb. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:57.999723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 222/446] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:58.012546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:58.015007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:58.160152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-338916b4-0a81-4a37-bbc2-af3a1c6b8b65 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.927561 Jul 14 15:59:58.167017 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 225/447] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 15:59:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:59:58.171538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd4f6392-ba52-40b3-b440-b24d7c44c6ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:58.172428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd4f6392-ba52-40b3-b440-b24d7c44c6ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:58.273712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bd4f6392-ba52-40b3-b440-b24d7c44c6ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.282114 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd4f6392-ba52-40b3-b440-b24d7c44c6ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1219 microversion: 2.1 time: 0.114628 Jul 14 15:59:58.285654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 223/448] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:58 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:59.016123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.016738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.027185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.027632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.028424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.028858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.033443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:59.198930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.209121 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49ef99f5-5e1d-47cb-883e-67ecaaf8077a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.197237 Jul 14 15:59:59.212011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 226/449] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:59.299185 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-12c9bc3f-d700-4b03-a311-33c61c8e50c9 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.299907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-12c9bc3f-d700-4b03-a311-33c61c8e50c9 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.351796 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-12c9bc3f-d700-4b03-a311-33c61c8e50c9 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.360219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-12c9bc3f-d700-4b03-a311-33c61c8e50c9 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1219 microversion: 2.1 time: 0.064812 Jul 14 15:59:59.360841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 224/450] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:59.709568 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f78aa7a0-f440-4558-b156-419cab8b53d9"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:59.710984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.718003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.718449 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.719215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.719652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.226491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.227628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.233979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.234431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.235197 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.235639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.403259 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.410939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4c794f1b-aef7-4822-8786-0d72b8d62c3e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.188293 Jul 14 16:00:00.411514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 225/451] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:00.420844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.420844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.423809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.424421 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.425238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.425681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.488028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.496507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c86f267f-fcfd-4a91-9664-b39c0d5f4504 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1223 microversion: 2.1 time: 0.083879 Jul 14 16:00:00.497122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 226/452] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:01.273098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e29113b7-0259-40e8-9347-8264ed2b804d"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:01.275160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.277020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=54 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:01.282115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.282314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.283067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.283497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.921909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a69b4b36-323e-4757-bc26-b79602f6e2ba tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.216080 Jul 14 16:00:03.922457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b289833-44a9-4bb6-a696-ead4e295d4e0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.652944 Jul 14 16:00:03.922906 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 227/453] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 15:59:59 2022] POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments => generated 194 bytes in 4218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:03.923002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 227/454] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:00:01 2022] POST /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments => generated 194 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:03.931779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.932538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.937272 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.939763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.940244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.940655 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.941025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.941460 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.943192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:03.957139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.957758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.960012 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.960715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.011637 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.021310 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-332a5e28-85b2-4f5e-902c-94210bcfcbaa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1271 microversion: 2.1 time: 0.096946 Jul 14 16:00:04.022283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 228/455] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:04.131095 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.138748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f4b68df2-5dc4-44a5-9d1a-f69591638449 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.215092 Jul 14 16:00:04.139366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 228/456] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:05.040038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.040789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.052727 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.053255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.054113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.054618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.072871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:05.124544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.131840 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-39d16cb2-cf53-4480-aa4d-8c757fd5078e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1271 microversion: 2.1 time: 0.096797 Jul 14 16:00:05.132634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 229/457] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:05.155939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.156642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.163488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.164004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.164886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.165495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.308118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.315786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e14acff-efb6-4988-987f-4d7ac9d883c2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.163706 Jul 14 16:00:05.316375 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 229/458] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:06.150242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.150889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.158068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.158518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.159328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.159764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.221026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.229219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d6ae7f08-7118-47d4-a504-d40408d48161 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1271 microversion: 2.1 time: 0.083294 Jul 14 16:00:06.229829 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 230/459] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:06.333776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.334385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.341379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.341824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.342582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.343011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.473615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.482422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-212b10d8-933e-4456-b3ea-336a03581d14 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.152450 Jul 14 16:00:06.483917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 230/460] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.245813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.246367 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.253393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.253839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.254603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.255038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.323350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.331153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8cc93ce5-b278-4430-b05c-847917b43b70 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1271 microversion: 2.1 time: 0.089947 Jul 14 16:00:07.338387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 231/461] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.499866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.500595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.507338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.508031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.509032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.509651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.656467 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.664330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-119946ba-972f-41c9-887f-d9a5edf4819a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.168497 Jul 14 16:00:07.665738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 231/462] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:08.153129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1520343158", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "networks": [{"uuid": "36809030-b359-441e-8645-43dc503e5c0f"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:08.207265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] validate_networks() for [('36809030-b359-441e-8645-43dc503e5c0f', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:00:08.349598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.350212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.352038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:08.353010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:08.358247 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.358918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.359692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.360318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.450923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.458358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5aa3f0de-1854-4d5d-b825-63c232e5c740 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1277 microversion: 2.1 time: 0.112751 Jul 14 16:00:08.458903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 232/463] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:08.610695 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:00:08.611289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:00:08.611770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:00:08.612202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:00:08.612613 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:00:08.623456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.623907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.624760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.625275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.642132 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Getting quotas for project a02d8a2f826a4475982abb77ccc636f5. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:00:08.646101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Getting quotas for user f891f70cc0e34e1f98116dec9c09cc5f and project a02d8a2f826a4475982abb77ccc636f5. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:00:08.657403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:00:08.659655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:00:08.682723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.683466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.689889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.690385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.691126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.691566 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.823947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.831418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c9d3e75-f796-4133-a6c7-0eaa7ea54ac2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.153310 Jul 14 16:00:08.832026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 233/464] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:08.960483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d1a701e-b908-4797-ad3e-8c758ba2fbcd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.810807 Jul 14 16:00:08.961051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 232/465] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:00:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:00:08.971662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa321fb4-3213-4600-a44a-13b90330242c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.972401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa321fb4-3213-4600-a44a-13b90330242c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.029557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa321fb4-3213-4600-a44a-13b90330242c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.036268 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa321fb4-3213-4600-a44a-13b90330242c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1223 microversion: 2.1 time: 0.068508 Jul 14 16:00:09.036834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 234/466] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1223 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.477120 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.477868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.486089 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.486628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.488403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.488403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.631808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.648594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f074f095-241d-4fcb-995e-1fb16872b3aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.176378 Jul 14 16:00:09.658886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 233/467] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.748744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-cd9316c1-7da4-46ff-bbc0-2d2bebe4e0fb req-2e94abfd-d60e-4ee5-bc1e-0989b5b0b19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "name": "network-vif-plugged", "status": "completed", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:09.757930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cd9316c1-7da4-46ff-bbc0-2d2bebe4e0fb req-2e94abfd-d60e-4ee5-bc1e-0989b5b0b19d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.758371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cd9316c1-7da4-46ff-bbc0-2d2bebe4e0fb req-2e94abfd-d60e-4ee5-bc1e-0989b5b0b19d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.769388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-cd9316c1-7da4-46ff-bbc0-2d2bebe4e0fb req-2e94abfd-d60e-4ee5-bc1e-0989b5b0b19d service nova] Creating event network-vif-plugged:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:00:09.774217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-cd9316c1-7da4-46ff-bbc0-2d2bebe4e0fb req-2e94abfd-d60e-4ee5-bc1e-0989b5b0b19d service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029177 Jul 14 16:00:09.774803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 235/468] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:09.849337 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.849948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.869103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.869558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.870340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.875151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.055934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e29eaeec-3e47-4bdf-9df5-b0aced30803c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.056657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e29eaeec-3e47-4bdf-9df5-b0aced30803c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.068578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.077670 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2aeefe38-d539-447b-8c17-1ec0a674bf2f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.232097 Jul 14 16:00:10.078264 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 234/469] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.124836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e29eaeec-3e47-4bdf-9df5-b0aced30803c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.131636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e29eaeec-3e47-4bdf-9df5-b0aced30803c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1223 microversion: 2.1 time: 0.080796 Jul 14 16:00:10.132458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 236/470] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:10.217809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-8e1da14c-fea3-4eb3-99a0-a3c03f0609f5 req-047358b2-ab34-4ba0-b554-6db5e10e66ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7acc2a8c-67d3-4b29-8fec-b0e208ff3127", "tag": "1ea9ca04-c461-408f-a615-440109beb3b0"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:10.228490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-8e1da14c-fea3-4eb3-99a0-a3c03f0609f5 req-047358b2-ab34-4ba0-b554-6db5e10e66ca service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.229292 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-8e1da14c-fea3-4eb3-99a0-a3c03f0609f5 req-047358b2-ab34-4ba0-b554-6db5e10e66ca service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.248536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-8e1da14c-fea3-4eb3-99a0-a3c03f0609f5 req-047358b2-ab34-4ba0-b554-6db5e10e66ca service nova] Creating event network-changed:1ea9ca04-c461-408f-a615-440109beb3b0 for instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 on hv-cinder-84986 Jul 14 16:00:10.255396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-8e1da14c-fea3-4eb3-99a0-a3c03f0609f5 req-047358b2-ab34-4ba0-b554-6db5e10e66ca service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041454 Jul 14 16:00:10.256238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 235/471] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:10.667314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.667952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.674185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.674641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.675411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.675857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.806128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.813634 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34008867-cf0b-43a6-aa70-c1d1013d652a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.151422 Jul 14 16:00:10.814195 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 237/472] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:11.095804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.096538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.103084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.103551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.104359 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.104798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.150367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.151011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.157109 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.157561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.158322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.158755 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.232082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.239641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2116f322-19db-4355-adc3-992db4f07582 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1227 microversion: 2.1 time: 0.095138 Jul 14 16:00:11.241772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 238/473] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:11.262899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.270376 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8adbf17-2c83-4766-acd8-29682972792e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1361 microversion: 2.1 time: 0.179234 Jul 14 16:00:11.270942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 236/474] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:11.830750 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.831726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.838940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.839396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.840203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.840846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.978643 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.986090 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b346fb83-d755-404e-ae8f-8991b31f5e8a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.159152 Jul 14 16:00:11.986664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 239/475] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.258324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.258986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.265732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.266172 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.266948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.267379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.287099 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.287705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.294415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.294865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.295637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.296073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.330127 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.338139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cbcb49d-66b8-465f-a6c0-31e7db50370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1275 microversion: 2.1 time: 0.084238 Jul 14 16:00:12.338707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 237/476] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.428184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.436612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a71e469e-93ed-4121-a9aa-80e4ffe33ffa tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1551 microversion: 2.1 time: 0.153508 Jul 14 16:00:12.437189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 240/477] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:12.454135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.454754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.461210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.461736 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.462671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.463174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.593978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.602097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d8f0263-a5ef-4206-b451-43b553fab8be tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1551 microversion: 2.1 time: 0.151775 Jul 14 16:00:12.603415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 238/478] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.619787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.623536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.624332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Searching by: {'deleted': False, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa'} {{(pid=125266) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 16:00:12.631224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.631672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.634587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.634587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.732086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.multi_cell_list [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125266) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 16:00:12.829053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-869e20fc-9510-4331-898a-0f36d7425db3 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.213840 Jul 14 16:00:12.829919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 241/479] 10.222.0.119 () {58 vars in 1129 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers => generated 344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:12.841130 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.841787 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.848307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.848770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.849542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.849973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.983543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.991069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-21be0981-8e17-470d-9079-d3b7825c0372 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1551 microversion: 2.1 time: 0.154678 Jul 14 16:00:12.991633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 239/480] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:13.002810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.003431 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.011306 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.011758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.012585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.013027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.149098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.157194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d1def22-f577-4063-9770-76ee8caaca8b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.158345 Jul 14 16:00:13.157771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 242/481] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:13.356003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.356650 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.363013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.363461 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.364259 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.364697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.426123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.433825 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdb91097-33bb-4ed0-8825-2ceefe952194 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1275 microversion: 2.1 time: 0.082433 Jul 14 16:00:13.434391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 240/482] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.176445 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.177347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.184708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.185157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.185949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.186351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.321930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.325471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:14.329742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-324fb1c2-a520-4498-9c82-33bb5d796e7a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.159075 Jul 14 16:00:14.330305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 243/483] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.451211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.451729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.458465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.459023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.459790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.460525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.523980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.532108 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ee10ba2-9115-435d-a663-ddea3d3cbc33 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1275 microversion: 2.1 time: 0.084882 Jul 14 16:00:14.532748 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 241/484] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:15.347531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.348164 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.355890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.356370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.357138 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.357576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.487417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.496275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a82ced25-98fa-4f69-98c5-8a6e271efc2e tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.152936 Jul 14 16:00:15.496849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 244/485] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:15.548875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.549485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.556694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.557140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.557905 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.558337 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.621370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.628697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b7f30d0-2e75-44f3-8c6d-1b5640d80270 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1275 microversion: 2.1 time: 0.083674 Jul 14 16:00:15.629260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 242/486] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.090925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d654a753-dbd2-48f6-8584-97ce73dc763a"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:16.092052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.098089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.098717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.099486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.099922 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.514689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.515166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.521351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.521795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.522566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.523003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.682407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.713510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6956ee49-d21a-4fce-93f9-0a90a7b11a0b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.202959 Jul 14 16:00:16.714358 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 243/487] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.719474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.720093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.726598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.728885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.729316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.730009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.815104 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.823405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eab69bfc-04fd-4054-a612-7048ab81f177 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1283 microversion: 2.1 time: 0.107710 Jul 14 16:00:16.824122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 244/488] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:17.733023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.733668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.741715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.742181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.743122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.743859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.925617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:17.935126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6451356e-fe8f-4feb-ba34-bce6e7f534fd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.205972 Jul 14 16:00:17.935878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 245/489] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:17.940573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.941254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.949355 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.949810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.950792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.951231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.016331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:18.025086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a04f1376-d277-4593-9a25-8d35a2dbbd94 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1281 microversion: 2.1 time: 0.088185 Jul 14 16:00:18.030508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 246/490] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:18.136616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8473f5aa-e773-497e-a912-73b09d8ed070 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.048779 Jul 14 16:00:18.137652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 245/491] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:00:16 2022] POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments => generated 194 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:18.953549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.954553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.957523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:18.958372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=10 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:18.964254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.964715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.965505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.966070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.982623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:19.049101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.051650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.059105 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.059787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.060974 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.061515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.121625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.129230 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-880d9d70-1b19-492b-8afa-4e7e5fdbbaac tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.179641 Jul 14 16:00:19.129796 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 247/492] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:19.141973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aee640c4-35f1-4ad2-b818-8bea2dcfeae2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: .version_select at 0x7f0dc1f4a700>, body: {"keypair": {"name": "tempest-keypair-74945037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLko5Qio8CbNhz9VFh2FwlMZZl800890Mn4B/yuGBwCO2UN2d/2Y9JnNdIiQGJRb+i/WIex9ZPrt2hl8FpwHpThtvtWOM/ZrWEdWouPVU+Qua/+vDdSxz3UTt9vxu54GZw=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:19.158226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-aee640c4-35f1-4ad2-b818-8bea2dcfeae2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:00:19.162488 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-aee640c4-35f1-4ad2-b818-8bea2dcfeae2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:00:19.228488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.236153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-83a6599d-d5ce-4bb4-9ef5-3a3e148364a4 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.193379 Jul 14 16:00:19.236749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 246/493] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:19.241736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-32631d47-0369-4fa6-8f64-a95aeadb6f44 req-a6f4a1b0-0109-410a-b321-3b489a7cf32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e618db5-f999-40b6-866f-039df0612935", "tag": "b646b5b7-e4db-43a8-b0da-f647dd33b0c7"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:19.251058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-32631d47-0369-4fa6-8f64-a95aeadb6f44 req-a6f4a1b0-0109-410a-b321-3b489a7cf32b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.251738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-32631d47-0369-4fa6-8f64-a95aeadb6f44 req-a6f4a1b0-0109-410a-b321-3b489a7cf32b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.264246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-32631d47-0369-4fa6-8f64-a95aeadb6f44 req-a6f4a1b0-0109-410a-b321-3b489a7cf32b service nova] Creating event network-changed:b646b5b7-e4db-43a8-b0da-f647dd33b0c7 for instance 5e618db5-f999-40b6-866f-039df0612935 on hv-cinder-84986 Jul 14 16:00:19.269732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-32631d47-0369-4fa6-8f64-a95aeadb6f44 req-a6f4a1b0-0109-410a-b321-3b489a7cf32b service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031176 Jul 14 16:00:19.270266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 247/494] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:19.275676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aee640c4-35f1-4ad2-b818-8bea2dcfeae2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.136789 Jul 14 16:00:19.275676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 248/495] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:00:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:20.004458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-1da78df9-bf47-42da-b889-0abf47346975 req-aa6afa53-d3bf-4c0b-986e-c26162c5eda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7acc2a8c-67d3-4b29-8fec-b0e208ff3127", "name": "network-vif-plugged", "status": "completed", "tag": "1ea9ca04-c461-408f-a615-440109beb3b0"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:20.018207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1da78df9-bf47-42da-b889-0abf47346975 req-aa6afa53-d3bf-4c0b-986e-c26162c5eda2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.019007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1da78df9-bf47-42da-b889-0abf47346975 req-aa6afa53-d3bf-4c0b-986e-c26162c5eda2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.031925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-1da78df9-bf47-42da-b889-0abf47346975 req-aa6afa53-d3bf-4c0b-986e-c26162c5eda2 service nova] Creating event network-vif-plugged:1ea9ca04-c461-408f-a615-440109beb3b0 for instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 on hv-cinder-84986 Jul 14 16:00:20.037981 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-1da78df9-bf47-42da-b889-0abf47346975 req-aa6afa53-d3bf-4c0b-986e-c26162c5eda2 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038113 Jul 14 16:00:20.038612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 248/496] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:20.157165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.160518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.179578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.179578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.179578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.179578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.250950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:20.255599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.256432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.263765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.264252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.265041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.265486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.360497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:20.368510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc3defdd-514c-4e3b-aa54-c0cc03db5afb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.224533 Jul 14 16:00:20.369707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 249/497] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:20.427770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:20.436149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3d3a76b-ab70-438d-bffa-c2b45cbb8b2b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.186562 Jul 14 16:00:20.436723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 249/498] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:21.386262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.386877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.393544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.394110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.394863 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.395318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.453910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.455300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.461741 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.467396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.467396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.467396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.583344 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:21.591775 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a99fa0e-ebd3-463e-8709-6bffce91027b tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.209703 Jul 14 16:00:21.601543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 250/499] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:21.632459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:21.641043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06d50916-99ce-4cca-902b-3eb74238f23a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.191515 Jul 14 16:00:21.645745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 250/500] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:21.976538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1555235986", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81beb021-9d5c-47cd-b940-d1c5b4031ad6"}], "security_groups": [{"name": "tempest-securitygroup--983630985"}], "key_name": "tempest-keypair-74945037", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:22.078204 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] validate_networks() for [('81beb021-9d5c-47cd-b940-d1c5b4031ad6', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:00:22.448508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:00:22.449067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:00:22.449414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:00:22.449846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:00:22.450261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:00:22.459124 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.459574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.460677 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.461114 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.477907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:00:22.481881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:00:22.492751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:00:22.495633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:00:22.609698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.610308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.616970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.617411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.618820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.619363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.669993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:22.675453 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9f7d40ab-4d71-4bbf-8534-ff3889f6c8fa tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.703359 Jul 14 16:00:22.676462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 251/501] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:00:21 2022] POST /compute/v2.1/servers => generated 403 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:00:22.686128 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.686819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.706098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.706616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.707433 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.707865 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.789117 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.799712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f0f4c70-944d-4647-aab4-3199d74d21eb tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.194217 Jul 14 16:00:22.800858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 251/502] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:22.815236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e36080c2-3dd5-4d09-9884-b875ce14ddda tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.815881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e36080c2-3dd5-4d09-9884-b875ce14ddda tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.872092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.877039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdd3a774-1bd9-4756-b69c-409bc8fd93c8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.194677 Jul 14 16:00:22.877651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 252/503] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:22.891068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e36080c2-3dd5-4d09-9884-b875ce14ddda tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.897958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e36080c2-3dd5-4d09-9884-b875ce14ddda tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1244 microversion: 2.1 time: 0.095882 Jul 14 16:00:22.898521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 252/504] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:23.817888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.818532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.826579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.827033 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.827841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.828316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.895489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.896030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.903160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.903616 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.904436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.904892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.999503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.007282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-807c52de-8525-49f9-89ef-0702bc52af3f tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.193293 Jul 14 16:00:24.007852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 253/505] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:24.013126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.019025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.019408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.019855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.020647 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.021081 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.078360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.086222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a7b88af-fcec-4db2-91b8-e9a891918829 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.195282 Jul 14 16:00:24.086953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 253/506] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:24.098849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.106575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-515e55c9-5849-44d2-a53f-0d8d26fd463b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1248 microversion: 2.1 time: 0.097649 Jul 14 16:00:24.107139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 254/507] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:25.026096 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.026726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.033991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.034828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.036234 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.036683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.102893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.103525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.110659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.111115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.111896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.112368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.241736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.249640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-178c88f7-9068-44b8-88ed-b725ea7da5aa tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1319 microversion: 2.1 time: 0.227952 Jul 14 16:00:25.259477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 254/508] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:25.259477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.259477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.263385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.263850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.264680 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.265126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.287209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.294887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f250e274-a8ea-4020-abda-196396dfb70d tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.195894 Jul 14 16:00:25.295653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 255/509] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:25.326622 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.334444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f34f83b-25c2-4be2-9b04-5a8dbbe1b732 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1240 microversion: 2.1 time: 0.083208 Jul 14 16:00:25.335004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 255/510] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:26.267031 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.267617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.274204 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.275159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.275520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.275963 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.315196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.316050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.323809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.324578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.325276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.325808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.472578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.481218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9d6bc13d-c4f6-4446-8951-bcd208534507 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1469 microversion: 2.1 time: 0.218314 Jul 14 16:00:26.481807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 256/511] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:26.486418 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.487025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.489791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:26.494085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.494788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.496011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.496482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.512122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.521102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-801bea83-53be-4f6a-a799-5fc9c09c54c5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.211019 Jul 14 16:00:26.521939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 256/512] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:26.526856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-b92cfa8f-878e-4da5-bf69-ed5ed703ca46 req-0dbb0091-373e-4a44-864e-f576e7f4b901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e618db5-f999-40b6-866f-039df0612935", "name": "network-vif-plugged", "status": "completed", "tag": "b646b5b7-e4db-43a8-b0da-f647dd33b0c7"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:26.538308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b92cfa8f-878e-4da5-bf69-ed5ed703ca46 req-0dbb0091-373e-4a44-864e-f576e7f4b901 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.538308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b92cfa8f-878e-4da5-bf69-ed5ed703ca46 req-0dbb0091-373e-4a44-864e-f576e7f4b901 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.550677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-b92cfa8f-878e-4da5-bf69-ed5ed703ca46 req-0dbb0091-373e-4a44-864e-f576e7f4b901 service nova] Creating event network-vif-plugged:b646b5b7-e4db-43a8-b0da-f647dd33b0c7 for instance 5e618db5-f999-40b6-866f-039df0612935 on hv-cinder-84986 Jul 14 16:00:26.556223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-b92cfa8f-878e-4da5-bf69-ed5ed703ca46 req-0dbb0091-373e-4a44-864e-f576e7f4b901 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032164 Jul 14 16:00:26.556841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 257/513] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:26.561835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.572363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.572363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.573079 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.573382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.573382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.573382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.577394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6cb4f2ce-e126-4fcb-8a44-0e1af0f3f506 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1296 microversion: 2.1 time: 0.094578 Jul 14 16:00:26.577970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 257/514] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:26.597600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:27.537565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.538199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.545926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.549732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.549732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.549732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.692708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.700642 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-21181ce0-6cc4-445d-afda-d5c02fe7f88c tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.166793 Jul 14 16:00:27.701422 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 258/515] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:27.705848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.706446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.713847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.714300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.715076 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.715515 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.741795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b80bb7a9-3a3f-4e90-96ad-2b2c472b5714 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "DELETE /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 204 len: 0 microversion: 2.1 time: 1.183568 Jul 14 16:00:27.742502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 258/516] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:00:26 2022] DELETE /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 0 bytes in 1185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:00:27.751789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.752617 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.759394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.759867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.760676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.761107 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.778492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.786090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f40280dc-03ef-4ff4-be7e-a6fe80e6e496 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1296 microversion: 2.1 time: 0.083642 Jul 14 16:00:27.786668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 259/517] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:27.892308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.900201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e10e1380-c4f8-4783-9945-12c461de90bd tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1475 microversion: 2.1 time: 0.152819 Jul 14 16:00:27.900798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 259/518] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1475 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:28.718429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.718978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.725605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.726388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.727298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.727980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.803737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.804368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.811408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.811946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.812753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.813192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.832670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:28.884378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:28.887268 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:28.891654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-31447874-283f-40ac-ae28-857f75f8194e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1304 microversion: 2.1 time: 0.091886 Jul 14 16:00:28.892248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 260/519] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:28.894797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17244100-e3ef-4b4c-af46-945324cb2240 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.180428 Jul 14 16:00:28.895365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 260/520] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:28.917529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.918145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.924189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.924653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.925419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.925859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.057104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:29.064400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e0fbb59-3210-4e3c-8acb-95e305b940b4 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1475 microversion: 2.1 time: 0.150768 Jul 14 16:00:29.064986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 261/521] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:29.624728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8535db93-fad0-40d1-9f86-e36f1d8f6f97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:29.630955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8535db93-fad0-40d1-9f86-e36f1d8f6f97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.631412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8535db93-fad0-40d1-9f86-e36f1d8f6f97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.701512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8535db93-fad0-40d1-9f86-e36f1d8f6f97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Going to try to stop instance {{(pid=125267) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 16:00:29.912183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:29.912790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.919933 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.920394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.921151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.921618 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.928687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8535db93-fad0-40d1-9f86-e36f1d8f6f97 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action" status: 202 len: 0 microversion: 2.1 time: 0.307616 Jul 14 16:00:29.931124 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 261/522] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:00:29 2022] POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:29.935299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:29.936062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.942304 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.942761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.943526 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.943989 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.019909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.027448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ca03962-cbbb-4947-ab0f-ad178cea56fb tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1304 microversion: 2.1 time: 0.097044 Jul 14 16:00:30.028020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 262/523] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:29 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:30.032579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.033185 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.039081 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.039468 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.040473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.040916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.091610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.099275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b80e0e9-0876-477a-ac57-bedb6f4c1216 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.191031 Jul 14 16:00:30.099942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 262/524] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:29 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:30.104665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.105390 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.111516 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.111969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.112783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.113228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.223007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.232159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2e884c41-2da7-451c-ad2c-5330c9514a63 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.202931 Jul 14 16:00:30.232950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 263/525] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:30.266147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.273606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c216b188-d003-429a-b6d9-20bde8d836bc tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1475 microversion: 2.1 time: 0.172646 Jul 14 16:00:30.274170 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 263/526] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:31.044822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.045431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.051855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.052351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.053111 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.053546 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.118993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.119837 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.120480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.121301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:31.127068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.127249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e8fd12c-46a4-4dab-8a96-bbd3f5775a57 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1314 microversion: 2.1 time: 0.086136 Jul 14 16:00:31.127516 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.128021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 264/527] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1314 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:31.128619 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.129064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.250680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.251407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.257386 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.257914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.258928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.259371 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.264810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.273297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8bfcd731-90a6-4ca6-971c-98ab9a871b09 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.158049 Jul 14 16:00:31.273865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 264/528] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:31.291899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.292573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.306225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.306225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.306225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.306225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.689634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.698530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e482ba9c-f421-460b-a6f3-687109987dea tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.452957 Jul 14 16:00:31.699110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 265/529] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:31.717876 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.725308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ed8e940b-ed8d-44a5-beb4-4aa34df21736 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1475 microversion: 2.1 time: 0.438509 Jul 14 16:00:31.725881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 265/530] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1475 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:32.144151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.144688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.151501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.152313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.153097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.153760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.221788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.224030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb06a9f0-d488-4a48-b21d-a134d88bcdd3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1302 microversion: 2.1 time: 0.083893 Jul 14 16:00:32.224655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 266/531] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:32.289852 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.290575 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.297032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.297484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.298302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.298735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.435700 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.443146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d697184e-eb95-4627-aad2-5d0db94982ad tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.157115 Jul 14 16:00:32.443711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 266/532] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:32.717746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.718274 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.721018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:32.721980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=10 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:32.728261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.731836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.731836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.731836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.743037 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.744218 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.750226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.750677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.751442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.751894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.895098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:32.944675 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.945027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.945139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d1066784-85e1-4eff-b7f7-98b779601599 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.227828 Jul 14 16:00:32.945139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 267/533] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:32.952543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-702821e2-cb34-4a2e-8c06-a369177a82e6 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1475 microversion: 2.1 time: 0.213369 Jul 14 16:00:32.953052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 267/534] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:33.241851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.242479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.248957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.249411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.250181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.250614 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.324608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:33.332240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6d7c961-c1bc-4f31-8d54-0bfa5f6a33ca tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1302 microversion: 2.1 time: 0.094411 Jul 14 16:00:33.332814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 268/535] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:33.460550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.461166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.468778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.469230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.469993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.470446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.633474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:33.643740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b1db6ea-46ae-43ba-a948-c80da5b8e23f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1323 microversion: 2.1 time: 0.187312 Jul 14 16:00:33.644466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 268/536] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:33.958034 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.958642 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.966046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.966504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.967276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.967810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.970812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.971415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.979222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.979986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.981568 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.982256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.104617 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.116759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e3f0d9ac-cddc-41cd-b68c-7706cc05c34a tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1433 microversion: 2.1 time: 0.149528 Jul 14 16:00:34.117644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 269/537] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1433 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:34.217281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-430d5dbd-f16b-4322-a30d-3f7a6606fb63 req-066bebc4-ba11-4cbe-a47d-ff5a21f1fbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7acc2a8c-67d3-4b29-8fec-b0e208ff3127", "name": "network-vif-deleted", "tag": "1ea9ca04-c461-408f-a615-440109beb3b0"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:34.222949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:34.228849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-430d5dbd-f16b-4322-a30d-3f7a6606fb63 req-066bebc4-ba11-4cbe-a47d-ff5a21f1fbf3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.228849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-430d5dbd-f16b-4322-a30d-3f7a6606fb63 req-066bebc4-ba11-4cbe-a47d-ff5a21f1fbf3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.242283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-430d5dbd-f16b-4322-a30d-3f7a6606fb63 req-066bebc4-ba11-4cbe-a47d-ff5a21f1fbf3 service nova] Creating event network-vif-deleted:1ea9ca04-c461-408f-a615-440109beb3b0 for instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 on hv-cinder-84986 Jul 14 16:00:34.248409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-430d5dbd-f16b-4322-a30d-3f7a6606fb63 req-066bebc4-ba11-4cbe-a47d-ff5a21f1fbf3 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Jul 14 16:00:34.249184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 270/538] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:34.251441 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.261496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e0eb0c2b-b05c-4a2d-a9ae-3d0e7f2c1a86 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.306397 Jul 14 16:00:34.272241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 269/539] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:34.351589 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:34.352353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:34.359678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.360145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.360930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.361363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.503673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.511924 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b58b64c0-42ca-4782-bee9-b3a799c643f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.164672 Jul 14 16:00:34.512845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 271/540] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:34 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:34.661339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:34.662074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:34.673931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.674472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.675399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.675896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.815248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.823028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-75b2e004-8dc0-4261-9845-828572b28d4b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1512 microversion: 2.1 time: 0.165691 Jul 14 16:00:34.823610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 270/541] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:34 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:35.134112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.148416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.148416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.148416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.148416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.148969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.179481 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.180511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.181016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lazy-loading 'fault' on Instance uuid 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:35.226735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc90ff5846f6412c9a36a3f66fdc403c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976bae50af4d476b9195b2006bd707fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.235289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b7be63e-c87d-41f2-8c7e-8bbf31ec0270 tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 200 len: 1309 microversion: 2.1 time: 0.105824 Jul 14 16:00:35.236022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 272/542] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:35.278090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.280549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.286198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.286792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.287878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.288415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.443112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.443265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c682f75a-d87d-4361-8cde-ca2b0666542d req-2601e502-b65e-4104-a824-ddae25ae97f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049a39c1-4f3d-4d0b-9363-90141a78f8da", "tag": "da04afde-49ca-4d22-a6e3-9e21925af059"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:35.455845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c682f75a-d87d-4361-8cde-ca2b0666542d req-2601e502-b65e-4104-a824-ddae25ae97f4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.456585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c682f75a-d87d-4361-8cde-ca2b0666542d req-2601e502-b65e-4104-a824-ddae25ae97f4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.460621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b75a42c9-1e47-4adb-b5ca-42d9bb663cc3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.186757 Jul 14 16:00:35.461415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 271/543] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:35.471130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c682f75a-d87d-4361-8cde-ca2b0666542d req-2601e502-b65e-4104-a824-ddae25ae97f4 service nova] Creating event network-changed:da04afde-49ca-4d22-a6e3-9e21925af059 for instance 049a39c1-4f3d-4d0b-9363-90141a78f8da on hv-cinder-84986 Jul 14 16:00:35.475732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c682f75a-d87d-4361-8cde-ca2b0666542d req-2601e502-b65e-4104-a824-ddae25ae97f4 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037415 Jul 14 16:00:35.476393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 273/544] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:35.529548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.530163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.536397 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.536850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.537622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.538066 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.680608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.688960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c93c041c-0d36-4b9c-aab2-4c30d059074e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.163933 Jul 14 16:00:35.689538 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 272/545] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:36.255511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.256849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] [instance: 7acc2a8c-67d3-4b29-8fec-b0e208ff3127] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.263776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.264260 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.265044 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.265483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.281235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] HTTP exception thrown: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Request method failure captured: Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 HTTP/1.1 Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D16DftyQpnPEvvge1gvW1O_W62RJjXalrSxYViKk_YivvV1B0sxtxoNbFmn3AKNa_pdPj9dphMl8rpKJI_oTLSk1G4kN85mK-yP3RwY3afwNx94HaRMZaTJ_x5_nqH-4O_50YOHF5grb8bYhWwBTaQclgQB8V0-WBeHjwX8rsWXB5I Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 976bae50af4d476b9195b2006bd707fb Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-617650921 Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:00:36.282962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/976bae50af4d476b9195b2006bd707fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/976bae50af4d476b9195b2006bd707fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_976bae50af4d476b9195b2006bd707fb", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/976bae50af4d476b9195b2006bd707fb"}]}] Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-617650921 Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 976bae50af4d476b9195b2006bd707fb Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-617650921 Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-617650921-project Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: fc90ff5846f6412c9a36a3f66fdc403c Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-617650921-project Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. Jul 14 16:00:36.284651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '7acc2a8c-67d3-4b29-8fec-b0e208ff3127'} Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:36.285479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. Jul 14 16:00:36.286665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:00:36.287724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] Returning 404 to user: Instance 7acc2a8c-67d3-4b29-8fec-b0e208ff3127 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:36.287724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f3aa6bf2-cbed-4a1d-a92d-7669b50af7ba tempest-VolumesNegativeTest-617650921 tempest-VolumesNegativeTest-617650921-project] 10.222.0.119 "GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127" status: 404 len: 111 microversion: 2.1 time: 0.034031 Jul 14 16:00:36.287724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 274/546] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/7acc2a8c-67d3-4b29-8fec-b0e208ff3127 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:36.479949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.480590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.487236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.487720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.488686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.489094 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.641434 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.651267 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-59d25ec9-0fa6-4658-925c-f52b552a9f2c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.175315 Jul 14 16:00:36.652182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 273/547] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:36.706231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.706951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.714880 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.715885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.716893 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.717365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.859074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.868166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f529b144-8bb1-4878-8aed-db14feae955c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.165758 Jul 14 16:00:36.869343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 275/548] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:37.670012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.670742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.677497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.678082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.678923 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.679434 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.817162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:37.826244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f38bf210-fc0e-4e66-adfe-f953bbece393 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.160764 Jul 14 16:00:37.826787 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 274/549] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:37.886179 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.886872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.893539 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.893980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.894770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.895199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.047455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:38.053720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf6f88b2-10ed-4366-a106-3e371f22dfb6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.171960 Jul 14 16:00:38.054361 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 276/550] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:38.843707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:38.844375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:38.850788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.851241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.852164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.852612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.989167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:38.998279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d5c5b3e-4c1f-43cd-8223-5c34ec6ae963 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.158339 Jul 14 16:00:38.998854 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 275/551] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:38 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:39.071148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:39.073239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:39.080222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.080667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.081439 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.081871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.222129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:39.229894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5103c88f-0d63-4bea-86b2-7dc0aca43363 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.162995 Jul 14 16:00:39.230459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 277/552] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:39 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:40.015634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.016291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.022775 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.023222 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.023980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.024445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.160028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.168968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-109f4493-3cbc-4703-8e70-fd4f1273d623 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.157298 Jul 14 16:00:40.169539 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 276/553] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:40.245869 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.246471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.252910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.253360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.254119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.254567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.396365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.405484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:40.408058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-295af28f-82a6-4df3-9eed-da71a7ef0b68 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.166337 Jul 14 16:00:40.409216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 278/554] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:41.187099 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.187818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.194514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.195043 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.196002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.196525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.343852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.346224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1077256-0c47-4d1a-848b-57c7a278228b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.163121 Jul 14 16:00:41.347765 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 277/555] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:41.424664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.425428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.435794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.436279 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.437060 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.437492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.635590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.646160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d8bd6df-4b8a-4e16-8e11-d20eddbac11d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.225224 Jul 14 16:00:41.646901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 279/556] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:42.364506 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.365176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.372358 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.372808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.373631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.374060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.514755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:42.522813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2e2e2898-df24-4642-8f17-3e2f54b3eb79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.162297 Jul 14 16:00:42.523379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 278/557] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:42.668733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.669293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.676077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.676555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.677334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.677771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.701407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.702178 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.708344 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.708810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.709573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.710094 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.894594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:42.894594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a7be88de-a1a3-463c-89e0-4a7126ec1c22 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.235181 Jul 14 16:00:42.898818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 280/558] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:42.900445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:42.909000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1a7c84bb-c74f-4d8a-aa7a-827c1ccff888 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1597 microversion: 2.1 time: 0.211955 Jul 14 16:00:42.909591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 279/559] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1597 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:43.545777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:43.550145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:43.563537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-81248f65-80bb-4611-8fab-a061a855388d req-8768a1a9-f418-4199-a15a-2138ae3ea8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049a39c1-4f3d-4d0b-9363-90141a78f8da", "name": "network-vif-plugged", "status": "completed", "tag": "da04afde-49ca-4d22-a6e3-9e21925af059"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:43.564541 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.565152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.566142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.566587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.579702 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-81248f65-80bb-4611-8fab-a061a855388d req-8768a1a9-f418-4199-a15a-2138ae3ea8ee service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.583476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-81248f65-80bb-4611-8fab-a061a855388d req-8768a1a9-f418-4199-a15a-2138ae3ea8ee service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.605566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-81248f65-80bb-4611-8fab-a061a855388d req-8768a1a9-f418-4199-a15a-2138ae3ea8ee service nova] Creating event network-vif-plugged:da04afde-49ca-4d22-a6e3-9e21925af059 for instance 049a39c1-4f3d-4d0b-9363-90141a78f8da on hv-cinder-84986 Jul 14 16:00:43.610823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-81248f65-80bb-4611-8fab-a061a855388d req-8768a1a9-f418-4199-a15a-2138ae3ea8ee service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051233 Jul 14 16:00:43.611729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 280/560] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:43.833236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:43.843711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a60bfb8-171a-4a56-b2c2-a4762ef4d5ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.305574 Jul 14 16:00:43.844433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 281/561] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:43 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:43.913471 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:43.914182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:43.921565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.922318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.923328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.923913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.200480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:44.208603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac3b6eb2-2751-4f39-a60c-9997672d8744 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.300802 Jul 14 16:00:44.219764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 281/562] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:43 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:44.863846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:44.864991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:44.878788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.879998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.881676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.882151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.142925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:45.152344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-09b99dea-ae0d-40a8-9e9b-e4963caf2b6e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.293891 Jul 14 16:00:45.153270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 282/563] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:44 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:45.226795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:45.227638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:45.245749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.245749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.245749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.245749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.246126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:45.708351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:45.716014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6a977d60-6f99-45ba-a8d8-0f89cf058f4d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1369 microversion: 2.1 time: 0.493271 Jul 14 16:00:45.716972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 282/564] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:45 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1369 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:45.787730 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e6511bc2-0660-40a9-a37e-a1f9103131e7 req-9d51d9c8-a2ec-411e-ba8c-7fc6836fc975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:45.800737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e6511bc2-0660-40a9-a37e-a1f9103131e7 req-9d51d9c8-a2ec-411e-ba8c-7fc6836fc975 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.801168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e6511bc2-0660-40a9-a37e-a1f9103131e7 req-9d51d9c8-a2ec-411e-ba8c-7fc6836fc975 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.814384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e6511bc2-0660-40a9-a37e-a1f9103131e7 req-9d51d9c8-a2ec-411e-ba8c-7fc6836fc975 service nova] Creating event network-changed:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:00:45.819764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e6511bc2-0660-40a9-a37e-a1f9103131e7 req-9d51d9c8-a2ec-411e-ba8c-7fc6836fc975 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036329 Jul 14 16:00:45.820535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 283/565] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:46.180491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.180491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.181010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.181691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.182717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.183167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.347116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:46.357470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-33cdb44e-5109-4b2a-9768-9e97558c27e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.191106 Jul 14 16:00:46.368428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 283/566] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:46.740051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.741031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.750554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.751967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.752854 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.753295 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.896202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:46.904484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c4ff3601-0484-40fd-98f1-00f291e9ae65 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1559 microversion: 2.1 time: 0.169321 Jul 14 16:00:46.905053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 284/567] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:46.923084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.923499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.929848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.930328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.931102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.931648 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.011187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7bf8ccde-097d-416a-83b5-05c6ed59cc99 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092847 Jul 14 16:00:47.011856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 284/568] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:47.376429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:47.377072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:47.384377 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.392146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.392146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.392146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.621600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:47.629836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-518edcde-3bdd-440a-a451-2e1e4f5c3da1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.257796 Jul 14 16:00:47.638581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 285/569] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:47 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:48.186391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-fc9f186e-bdbc-42cb-acba-39e593690ec1 req-0f8c6e5b-9b2c-49d0-86a9-795a46757d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049a39c1-4f3d-4d0b-9363-90141a78f8da", "tag": "da04afde-49ca-4d22-a6e3-9e21925af059"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:48.195156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc9f186e-bdbc-42cb-acba-39e593690ec1 req-0f8c6e5b-9b2c-49d0-86a9-795a46757d83 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.195936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc9f186e-bdbc-42cb-acba-39e593690ec1 req-0f8c6e5b-9b2c-49d0-86a9-795a46757d83 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.207704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-fc9f186e-bdbc-42cb-acba-39e593690ec1 req-0f8c6e5b-9b2c-49d0-86a9-795a46757d83 service nova] Creating event network-changed:da04afde-49ca-4d22-a6e3-9e21925af059 for instance 049a39c1-4f3d-4d0b-9363-90141a78f8da on hv-cinder-84986 Jul 14 16:00:48.213431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-fc9f186e-bdbc-42cb-acba-39e593690ec1 req-0f8c6e5b-9b2c-49d0-86a9-795a46757d83 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032721 Jul 14 16:00:48.214082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 285/570] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:48.652087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:48.653478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:48.668482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.668939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.670204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.670827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.900638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:48.909958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4018e6f2-359b-4a40-a3e1-efcb70601e43 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.265032 Jul 14 16:00:48.911362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 286/571] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:48 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:49.079597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1504450252"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:49.080340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.087094 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.088314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.089105 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.089549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.249452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.network.security_group_api [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Adding security group e620addb-261f-4a04-8075-87e59777a29f to port ceb2f3fe-a0a1-43df-b885-d12cb859d85a Jul 14 16:00:49.688827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4e208e0c-1d1b-457a-a15a-257b21942719 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action" status: 202 len: 0 microversion: 2.1 time: 0.613500 Jul 14 16:00:49.690231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 286/572] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:00:49 2022] POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:49.701712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:49.702330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.708860 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.709561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.711302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.711958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.880937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:49.890253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68a7735c-0736-44a1-8731-8d8e4c9d6dc1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1763 microversion: 2.1 time: 0.194815 Jul 14 16:00:49.890759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 287/573] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:49 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1763 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:49.929959 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:49.930571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.936957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.937412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.938179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.938634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.079182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:50.088265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8a1a3b5-2ea3-4927-b871-4c91ef2d85c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.161467 Jul 14 16:00:50.100221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 287/574] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:49 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:50.230642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-75b44c0f-8fce-4ff3-a32b-83f35c782ced req-f8766024-4b09-4fbe-98e9-43f9ea81680f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:50.238964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-75b44c0f-8fce-4ff3-a32b-83f35c782ced req-f8766024-4b09-4fbe-98e9-43f9ea81680f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.239469 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-75b44c0f-8fce-4ff3-a32b-83f35c782ced req-f8766024-4b09-4fbe-98e9-43f9ea81680f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.253552 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-75b44c0f-8fce-4ff3-a32b-83f35c782ced req-f8766024-4b09-4fbe-98e9-43f9ea81680f service nova] Creating event network-changed:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:00:50.258587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-75b44c0f-8fce-4ff3-a32b-83f35c782ced req-f8766024-4b09-4fbe-98e9-43f9ea81680f service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Jul 14 16:00:50.259359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 288/575] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:51.105517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:51.106124 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:51.112610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.113057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.113815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.114244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.250336 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:51.258804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-844365c0-3104-401d-a69f-8cb37fe010d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.157107 Jul 14 16:00:51.259400 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 288/576] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:51 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:52.277755 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:52.278491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:52.284908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.285365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.286141 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.286574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.424858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:52.433315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-caa4ee26-a2e2-478a-8246-cfe20e862496 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.160844 Jul 14 16:00:52.435839 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 289/577] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:52 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:53.451227 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:53.451839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:53.458566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.459020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.459802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.460275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.592406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:53.600795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01d46396-526a-4dcc-bcf9-b40b0ae89389 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.153800 Jul 14 16:00:53.601366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 289/578] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:53 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:54.618624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.619229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.625990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.626434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.627192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.627624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.758271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:54.766997 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e55179c-79a3-42e3-a010-626544ebc99d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.152251 Jul 14 16:00:54.767558 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 290/579] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:55.784301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:55.784836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:55.791520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.791972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.792764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.793198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.919457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:55.927666 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8927c18e-28a0-47a7-901a-fb8df9ae9009 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.147308 Jul 14 16:00:55.928280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 290/580] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:55 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:56.945217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:56.945837 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.952453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.952905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.953858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.954297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.091914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:57.100160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66d31331-17ff-441e-abe3-b776f8bef4df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1728 microversion: 2.1 time: 0.158885 Jul 14 16:00:57.108470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 291/581] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:56 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:58.117709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.118317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.120904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=68 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:58.125752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.126202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.126966 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.127407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.257277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:58.266279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0936d715-43d9-4044-9e41-d3a3b146f61b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1705 microversion: 2.1 time: 0.152420 Jul 14 16:00:58.266904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 291/582] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1705 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:58.283213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7dcabf18-f331-44c9-8625-be47ebb9a7e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:58.289722 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dcabf18-f331-44c9-8625-be47ebb9a7e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.290172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dcabf18-f331-44c9-8625-be47ebb9a7e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.349543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7dcabf18-f331-44c9-8625-be47ebb9a7e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Going to try to start instance {{(pid=125266) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 16:00:58.584970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7dcabf18-f331-44c9-8625-be47ebb9a7e5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action" status: 202 len: 0 microversion: 2.1 time: 0.305354 Jul 14 16:00:58.588795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 292/583] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:00:58 2022] POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:58.596971 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.597584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.604560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.604937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.605760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.606217 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.740283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:58.748570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f9aef54-ec34-4269-ac3d-279b66521376 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1714 microversion: 2.1 time: 0.156644 Jul 14 16:00:58.749143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 292/584] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:59.767372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:59.768077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:59.774333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.774815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.776329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.776774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.912456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:59.920958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3878b2de-217f-4f26-82d3-18f544f17d0b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1714 microversion: 2.1 time: 0.158156 Jul 14 16:00:59.921534 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 293/585] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:00:59 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:00.938372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:00.939010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:00.945578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.946026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.946822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.947802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.078027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:01.086696 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dd396ea6-0ffe-41d5-b796-6b3393310c8d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1718 microversion: 2.1 time: 0.152204 Jul 14 16:01:01.087273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 293/586] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:00 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:09.687149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059dccd8-79c5-4fab-99d5-cd9da4ee24ef", "device": "/dev/sdb"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:09.688732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.691384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=50 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:09.697051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.698171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.699171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.699613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.344584 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:10.599686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c345e13b-303f-4e8c-adf2-15e662b0b88f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "POST /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916269 Jul 14 16:01:10.601176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 294/587] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:01:09 2022] POST /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:15.721641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=5 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:15.732507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=63 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:15.894065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-58a692e4-ff04-4989-8edc-0a90a29eae81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Action: 'create', calling method: .version_select at 0x7f0dc1ecbee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2057527239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ehZd00P8TPA0vM+wfhxWeIcRa0DU+bpKl8EBFtXrtkSxvqAUHf8MMlbbCf2zvZR12irUCIwVnaB4UIbkP/J63Vnw167WUx13onZEwuQbC9oc2h0S+zYYT7zZM8UGgjg=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:15.909547 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-58a692e4-ff04-4989-8edc-0a90a29eae81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for project 1207210005f34c4aabbe6966e469c1a0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:15.913707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-58a692e4-ff04-4989-8edc-0a90a29eae81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for user 56191d451ddf4fba953c27dd79484723 and project 1207210005f34c4aabbe6966e469c1a0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:16.108928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-58a692e4-ff04-4989-8edc-0a90a29eae81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.391984 Jul 14 16:01:16.109632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 294/588] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:01:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:37.270923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:37.381498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30be4b81-919e-4651-9214-157b077e0545"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:37.382723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.389975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.390427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.391205 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.391642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.917509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d17690a-6982-49ec-8715-a19fd081265a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.647756 Jul 14 16:01:38.918286 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 295/589] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:01:37 2022] POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 194 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.355324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:53.356162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:53.360326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.360829 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.367168 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.367620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.368631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.368921 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.554028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lazy-loading 'services' on Instance uuid 5e618db5-f999-40b6-866f-039df0612935 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:53.827340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-247cac72-773c-4868-8be7-8f08577dd6a2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935/os-volume_attachments/059dccd8-79c5-4fab-99d5-cd9da4ee24ef" status: 202 len: 0 microversion: 2.1 time: 0.473858 Jul 14 16:01:53.828068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 295/590] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:01:53 2022] DELETE /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935/os-volume_attachments/059dccd8-79c5-4fab-99d5-cd9da4ee24ef => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:54.831177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:54.831985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:54.836692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:54.841444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:54.845143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.845598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.846366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.846805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.869574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'flavor' on Instance uuid 4fd3f295-799c-49ef-a570-bfb044012311 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:55.230574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3aaa7cbe-6cf7-4734-8c74-b4a56a1b4ba0 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/action" status: 200 len: 32 microversion: 2.1 time: 0.400592 Jul 14 16:01:55.231398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 296/591] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:01:54 2022] POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:01:55.241913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:55.242725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:55.250001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.250541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.251313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.251760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.386299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:55.395029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3002fd30-08df-48f0-9d7a-1bae570ccccd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.157955 Jul 14 16:01:55.400249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 296/592] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:55 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:55.966104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1032532359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057527239", "security_groups": [{"name": "tempest-secgroup-smoke-695602955"}], "block_device_mapping_v2": [{"uuid": "1032730e-f7a8-407a-91af-62e9707c7820", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c436165-5659-4f64-9bb3-46eb0ae69617"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:56.088346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] validate_networks() for [('7c436165-5659-4f64-9bb3-46eb0ae69617', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:01:56.156237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.156736 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.162927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.163642 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.164598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.165235 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.192721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:56.536894 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0e8f447-683a-4587-aae8-546746ee4f62 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 204 len: 0 microversion: 2.1 time: 0.384177 Jul 14 16:01:56.539600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 297/593] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:01:56 2022] DELETE /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:01:56.544135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.544966 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.555605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.556058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.558619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.559872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.560225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:01:56.560667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:01:56.561161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:01:56.561612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:01:56.562016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:01:56.571846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.572423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.574139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.574574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.592899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:56.597126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for user 56191d451ddf4fba953c27dd79484723 and project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:56.657773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:01:56.659986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1032730e-f7a8-407a-91af-62e9707c7820',volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:01:56.706944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:56.716881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a4473750-e528-460d-9046-7ac00381b1dd tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.178064 Jul 14 16:01:56.717456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 298/594] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:56.722061 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.722662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.728354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.728804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.730196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.730628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.868264 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:56.876928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-de38848a-9c9e-4081-9f5d-9ab5417020e2 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1518 microversion: 2.1 time: 0.158064 Jul 14 16:01:56.877834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 299/595] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:57.151172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a0d147dd-249f-4417-a1d3-1842eefbabed tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.190228 Jul 14 16:01:57.152341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 297/596] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:01:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:01:57.162561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-50ebd5d0-21db-4908-8004-5cf53114d989 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.163150 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-50ebd5d0-21db-4908-8004-5cf53114d989 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.218320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-50ebd5d0-21db-4908-8004-5cf53114d989 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.225070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-50ebd5d0-21db-4908-8004-5cf53114d989 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1098 microversion: 2.1 time: 0.066352 Jul 14 16:01:57.229618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 300/597] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:57.734698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.735351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.741964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.742420 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.743248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.743683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.878419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.885285 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7421f3c1-9a11-43e9-a1a8-884ba5ae59d3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.154672 Jul 14 16:01:57.886596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 298/598] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:57.894252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.895484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.902833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.903282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.904051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.904524 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.036430 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.044770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-88872d94-222d-4663-9a85-0fa7beef1ad3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1518 microversion: 2.1 time: 0.154381 Jul 14 16:01:58.049585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 301/599] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:58.244178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18570bd3-ea0f-4520-b039-a434325db494 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.245723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18570bd3-ea0f-4520-b039-a434325db494 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.298808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18570bd3-ea0f-4520-b039-a434325db494 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.305516 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18570bd3-ea0f-4520-b039-a434325db494 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1098 microversion: 2.1 time: 0.065279 Jul 14 16:01:58.306154 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 299/600] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1098 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:58.903759 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.904491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.911463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.911908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.912730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.913170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.046461 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.054533 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac67157a-4bb4-42fc-85bd-3e74b96470f5 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.155466 Jul 14 16:01:59.055099 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 302/601] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:59.063300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:59.063912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.070433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.070908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.071671 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.072224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.204130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.212120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d152f913-014f-43da-a2ba-503f101909e5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1518 microversion: 2.1 time: 0.152460 Jul 14 16:01:59.212710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 300/602] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:59 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:59.322388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:59.323886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.329973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.330423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.331190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.331626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.396318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.412876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4ddeac47-e4a1-410e-a559-43c4b5de6b22 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1140 microversion: 2.1 time: 0.085654 Jul 14 16:01:59.412876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 303/603] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:01:59 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1140 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:59.863478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c80ebb4d-ed35-4611-958a-fced6f628cc8 req-2a695a97-6da1-4e52-aa51-c91102eb6556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e618db5-f999-40b6-866f-039df0612935", "name": "network-vif-deleted", "tag": "b646b5b7-e4db-43a8-b0da-f647dd33b0c7"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:59.872703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c80ebb4d-ed35-4611-958a-fced6f628cc8 req-2a695a97-6da1-4e52-aa51-c91102eb6556 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.873140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c80ebb4d-ed35-4611-958a-fced6f628cc8 req-2a695a97-6da1-4e52-aa51-c91102eb6556 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.883970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c80ebb4d-ed35-4611-958a-fced6f628cc8 req-2a695a97-6da1-4e52-aa51-c91102eb6556 service nova] Creating event network-vif-deleted:b646b5b7-e4db-43a8-b0da-f647dd33b0c7 for instance 5e618db5-f999-40b6-866f-039df0612935 on hv-cinder-84986 Jul 14 16:01:59.889809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c80ebb4d-ed35-4611-958a-fced6f628cc8 req-2a695a97-6da1-4e52-aa51-c91102eb6556 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030127 Jul 14 16:01:59.890400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 301/604] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:00.074965 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.076555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.084015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.084501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.085277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.085720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.230566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.236783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.237671 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.238974 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-effa2aae-8636-4fbd-a21b-f3b279692a6d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.170519 Jul 14 16:02:00.239557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 304/605] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:00.245724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.246278 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.247151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.247645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.313014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.321181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25114d3b-0334-4fbe-a65c-5e6b844e9410 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1308 microversion: 2.1 time: 0.095371 Jul 14 16:02:00.321789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 302/606] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:00.423186 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.423856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.430644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.431146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.431925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.432995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.501307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.515349 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-faf9d68c-0755-4478-b8ac-9fbb544d10c0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1204 microversion: 2.1 time: 0.097033 Jul 14 16:02:00.520196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 305/607] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:01.256205 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.256862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.264300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.264743 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.265533 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.265967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.338668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.339560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.346336 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.346881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.347716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.348247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.386306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.387040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.387659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lazy-loading 'fault' on Instance uuid 5e618db5-f999-40b6-866f-039df0612935 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:02:01.428505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:01.437780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7a4ffa2-bd75-4e21-97e5-24e739979cbb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.185543 Jul 14 16:02:01.438555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 303/608] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:01.457130 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:01.464391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15aebd37-58fa-4258-bd13-f3ec5ea94335 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 200 len: 1313 microversion: 2.1 time: 0.129920 Jul 14 16:02:01.465051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 306/609] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 1313 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:01.533227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.533877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.541638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.542168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.543177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.543620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.609501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:01.616906 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-293b2824-418b-4506-8ce4-002b2efe2d9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1214 microversion: 2.1 time: 0.087536 Jul 14 16:02:01.621637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 304/610] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:02.454931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:02.455528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.462224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.462668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.463450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.464003 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.483182 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:02.483796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 5e618db5-f999-40b6-866f-039df0612935] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.490140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.490590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.491540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.492168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.533062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] HTTP exception thrown: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Request method failure captured: Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 HTTP/1.1 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D2EuS5MW-_Gib95PDRpJFNJ5ZDMppw_no-LpRm7zXWoJ1r9HeOG3Osf_VOD65MBV-lEEtpIzzzGcsdlLHI3os9b9MY-G_tzhjH-zOZzxizpJxIqyEr4QGJhHP56Pij0Az48Crs-ug1nKw0yxKg0VODWDsWkcl8Uku5LVLkIo26cixA Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: a02d8a2f826a4475982abb77ccc636f5 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:02:02.534704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a02d8a2f826a4475982abb77ccc636f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a02d8a2f826a4475982abb77ccc636f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a02d8a2f826a4475982abb77ccc636f5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a02d8a2f826a4475982abb77ccc636f5"}]}] Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: a02d8a2f826a4475982abb77ccc636f5 Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotTestJSON-1279572182-project Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: f891f70cc0e34e1f98116dec9c09cc5f Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotTestJSON-1279572182-project Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. Jul 14 16:02:02.536282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '5e618db5-f999-40b6-866f-039df0612935'} Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:02:02.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. Jul 14 16:02:02.538640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:02.539969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Returning 404 to user: Instance 5e618db5-f999-40b6-866f-039df0612935 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:02:02.539969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9527840a-4b4d-43c4-9b6c-29dd420aa1d3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935" status: 404 len: 111 microversion: 2.1 time: 0.057813 Jul 14 16:02:02.543496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 305/611] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:02 2022] GET /compute/v2.1/servers/5e618db5-f999-40b6-866f-039df0612935 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:02:02.635820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:02.636747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.648605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.649305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.650323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.651011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.679881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:02.689457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7745c39e-56c0-4c1a-8526-bb9cc0288091 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.238477 Jul 14 16:02:02.700579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 307/612] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:02 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:02.817482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:02.826215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1cd0f06-466a-4955-90cc-5b81e72416f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1281 microversion: 2.1 time: 0.195708 Jul 14 16:02:02.832286 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 306/613] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:02 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:02.965726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-e29eae92-116b-42f6-95e1-a4a085b77bc1 req-4efdfc01-e0be-4324-bd71-bcec2547cff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdf0e60-fc39-4efd-82dc-737d584be96d", "tag": "6a647d8b-907e-42ff-91de-7ab478625df1"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:02.981319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e29eae92-116b-42f6-95e1-a4a085b77bc1 req-4efdfc01-e0be-4324-bd71-bcec2547cff0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.981788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e29eae92-116b-42f6-95e1-a4a085b77bc1 req-4efdfc01-e0be-4324-bd71-bcec2547cff0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.003052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-e29eae92-116b-42f6-95e1-a4a085b77bc1 req-4efdfc01-e0be-4324-bd71-bcec2547cff0 service nova] Creating event network-changed:6a647d8b-907e-42ff-91de-7ab478625df1 for instance ffdf0e60-fc39-4efd-82dc-737d584be96d on hv-cinder-84986 Jul 14 16:02:03.008891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-e29eae92-116b-42f6-95e1-a4a085b77bc1 req-4efdfc01-e0be-4324-bd71-bcec2547cff0 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047112 Jul 14 16:02:03.009811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 308/614] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:03.707041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:03.708223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:03.716066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.716551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.717338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.717774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.845037 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:03.846443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:03.848845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:03.852837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.853374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.854532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.855159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.859823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7ffa82e5-a9d3-4779-bbb7-76ed86675c7a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.156422 Jul 14 16:02:03.860999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 307/615] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:03 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:04.003291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.011103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b936a6c-6022-43a7-b8c4-b8385e65ba30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.170980 Jul 14 16:02:04.011667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 309/616] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:03 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:04.877645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.878254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:04.884852 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.885831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.886594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.887023 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.019419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:05.028532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-10ce7d5f-585a-45d1-ae45-d2d97a81d1f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.154727 Jul 14 16:02:05.028802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:05.029561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 308/617] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:05.029718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:05.035973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.036455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.037213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.037641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.056903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:05.172536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:05.179961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8e690b7-ea69-4d7f-bbd7-5d92ac386ceb tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.155587 Jul 14 16:02:05.180566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 310/618] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:05 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:06.046689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:06.047291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:06.053958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.054400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.055159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.055592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.187975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.196088 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c332db3f-17d4-41bb-93cb-5daefbd920a6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.153905 Jul 14 16:02:06.196689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 309/619] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:06 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:06.197323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:06.198017 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:06.204472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.204922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.205680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.206118 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.335363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.343384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a4afeb94-9ed0-47e1-825d-3906cfecc0a4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.149841 Jul 14 16:02:06.343962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 311/620] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:06 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:07.213844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.214446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.216480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:07.221785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.222231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.222990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.223425 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.361042 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.361636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.365388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:07.366168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.369070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.377968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.377968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.377968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.378250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ce3545c0-bf05-4ed8-be42-81bf05ffdbd6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.165953 Jul 14 16:02:07.378250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 310/621] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:07.516844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.518566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-839b64c1-8e57-445e-8d52-ae5b546c1a04 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.161265 Jul 14 16:02:07.519154 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 312/622] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:08.393721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.394376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.396737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:08.401645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.402101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.402870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.403343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.536620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.537226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.540292 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.545137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.545632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.546432 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.546864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.549290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61bdd0ff-6ab3-4fd5-998f-659f748e6a27 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.159798 Jul 14 16:02:08.549876 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 311/623] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:08.687714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.695221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8a220d9-e5ef-42ea-9051-2db5d81ad80c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.162589 Jul 14 16:02:08.695779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 313/624] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:09.566568 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.567188 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.574053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.574514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.575332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.575779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.712999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.714647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.715087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.721987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.722444 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.723557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.724034 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.730621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b509a7c7-d7d1-4a93-b2d1-59bb8da51dbe tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.161486 Jul 14 16:02:09.742928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 312/625] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.872858 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.880292 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18111dfa-50e4-48f0-bf0c-84234ce7e8c4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.171942 Jul 14 16:02:09.884814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 314/626] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:10.746785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.747497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.754181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.754632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.755395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.755830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.773721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:10.884045 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:10.893419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ecac463b-b176-441f-b856-17fb2806eea4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.150714 Jul 14 16:02:10.893991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 313/627] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:10.898132 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.898740 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.905931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.906375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.907143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.907574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.042818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.050404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e385b2b5-24f4-4aa3-a321-2f29bb44d5d8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.156024 Jul 14 16:02:11.050966 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 315/628] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:11.910790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:11.911457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:11.917945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.926982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.926982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.926982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.049220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.057228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4616ab93-e61d-4332-8528-7bb35b61b11e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.150331 Jul 14 16:02:12.057803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 314/629] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:11 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:12.068951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:12.069566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:12.076864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.077110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.077875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.078314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.208418 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.216361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-473eadfb-4b00-47aa-901f-907858412de4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.151024 Jul 14 16:02:12.217362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 316/630] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:12 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:13.073958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.074558 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.081577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.082020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.082772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.083202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.219756 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.227787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47ad4376-ab1d-4b1e-a61c-f95a016cd554 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.157890 Jul 14 16:02:13.228392 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 315/631] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:13.233747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.234407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.240961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.241736 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.242166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.242598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.373747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.381224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb66c289-5c20-4362-81da-e47a9bcb139c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.151852 Jul 14 16:02:13.381790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 317/632] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:14.244785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:14.245420 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:14.252334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.252776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.253804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.254231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.384003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:14.392801 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7edea01e-f68d-433e-8eae-bdef8bdc080a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.151690 Jul 14 16:02:14.393455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 316/633] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:14 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:14.398554 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:14.399169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:14.406160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.406640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.407413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.407853 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.538021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:14.545458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f8c32cb-6f9e-41b1-b8d1-a3fb54278a79 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.150690 Jul 14 16:02:14.546020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 318/634] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:14 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:15.410140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.410752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.417308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.417761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.418527 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.418966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.559024 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:15.561847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.562507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.567841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-39801655-59b3-40b1-8421-7a1349f17c4d tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.161541 Jul 14 16:02:15.568446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 317/635] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:15.569096 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.569680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.570449 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.570879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.708467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:15.716069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ee39d1c5-b956-4cf6-ab89-9fe919f7d689 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.158056 Jul 14 16:02:15.717487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 319/636] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:16.585323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:16.585934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:16.593531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.593982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.594738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.595177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.725404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.733498 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:16.734101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:16.736396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-43c33acc-2c49-4889-8100-d2cdd558055c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.154711 Jul 14 16:02:16.736978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 318/637] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:16 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:16.740627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.787953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.787953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.787953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.874459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.881838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6114118-8423-48c6-a39d-f40d0a6f803e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.152240 Jul 14 16:02:16.882399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 320/638] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:16 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:17.660731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1071777002", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "networks": [{"uuid": "36809030-b359-441e-8645-43dc503e5c0f"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:17.712618 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] validate_networks() for [('36809030-b359-441e-8645-43dc503e5c0f', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:02:17.754765 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.755503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.762035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.762489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.763904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.764301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.971713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.979584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eba55bd8-b12a-4197-a40c-32054a5accd8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.228713 Jul 14 16:02:17.980174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 321/639] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:17.984631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.985232 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.991101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.991616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.992407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.992841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.492506 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.497042 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:02:18.497870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:02:18.498525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:02:18.498945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:02:18.499452 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:02:18.501495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7d51078-e074-4483-a0d7-62ee09cdb009 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.520292 Jul 14 16:02:18.502074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 322/640] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:18.517201 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.517973 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.518791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.519235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.542428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Getting quotas for project a02d8a2f826a4475982abb77ccc636f5. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:02:18.548518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Getting quotas for user f891f70cc0e34e1f98116dec9c09cc5f and project a02d8a2f826a4475982abb77ccc636f5. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:02:18.560884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:02:18.563395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:02:18.675199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-441ad775-c6e7-4d00-986d-4a2fca10c26f tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.018070 Jul 14 16:02:18.676152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 319/641] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:02:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:02:18.685933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fe8ef3ba-17e9-4fc2-9dc2-bd1bb826c1a3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.686542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fe8ef3ba-17e9-4fc2-9dc2-bd1bb826c1a3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.744221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fe8ef3ba-17e9-4fc2-9dc2-bd1bb826c1a3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.751086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fe8ef3ba-17e9-4fc2-9dc2-bd1bb826c1a3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1223 microversion: 2.1 time: 0.069028 Jul 14 16:02:18.751663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 323/642] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1223 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:18.999106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.000167 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.008368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.009998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.010790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.011228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.160414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.168874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-78482960-d00b-46e0-921b-9fdd044a0352 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.175478 Jul 14 16:02:19.171793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 320/643] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:19.519163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.519991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.526604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.533828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.533828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.533828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.669166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.677243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bcd0d354-c823-4b56-87de-734716194e26 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.162061 Jul 14 16:02:19.677817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 324/644] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:19 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:19.768047 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.768736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.774891 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.775335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.776093 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.776547 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.835653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.844740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c13c1d7-a86c-4eb3-bab4-5c43c226a8c7 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1227 microversion: 2.1 time: 0.080907 Jul 14 16:02:19.845302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 321/645] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:19 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1227 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:20.185772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.186384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.192719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.193178 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.193950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.194396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.322898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.331294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2c7cbd9-030f-43e9-9163-c1db94717670 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.149361 Jul 14 16:02:20.331880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 325/646] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:20.694978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.695580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.702835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.703277 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.704034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.704498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.852200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.860751 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d954a1cf-14cf-407e-a6c4-f2fb1baf23fe tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.169542 Jul 14 16:02:20.861550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 322/647] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:20.862885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.863573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.870145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.870590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.871357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.871818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.933062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.941560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6a44a5c-2b18-426e-b13b-6d404e4abbf3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1227 microversion: 2.1 time: 0.083058 Jul 14 16:02:20.942135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 326/648] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1227 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:21.348575 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.349196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.355222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.355681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.356480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.356922 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.489482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:21.497711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8fb9843-bab5-4fd2-b9dd-b10f41bde548 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.152946 Jul 14 16:02:21.498294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 323/649] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:21.877659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.878311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.884876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.885365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.886131 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.886669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.958338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.958988 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.966032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.966488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.968849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.968849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.060825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.064651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.068256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87f74a83-3b35-4c70-96cb-3512e1259666 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1219 microversion: 2.1 time: 0.113943 Jul 14 16:02:22.068829 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 324/650] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:22.072237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-660af899-8ab5-4520-8d59-656da74c73ab tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.198364 Jul 14 16:02:22.072796 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 327/651] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:22.487543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-aee65ede-3db0-4759-91cf-c806ff44a189 req-24cb3688-d2ed-4c4f-ba5f-8db8bd352341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdf0e60-fc39-4efd-82dc-737d584be96d", "name": "network-vif-plugged", "status": "completed", "tag": "6a647d8b-907e-42ff-91de-7ab478625df1"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:22.495478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-aee65ede-3db0-4759-91cf-c806ff44a189 req-24cb3688-d2ed-4c4f-ba5f-8db8bd352341 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.495922 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-aee65ede-3db0-4759-91cf-c806ff44a189 req-24cb3688-d2ed-4c4f-ba5f-8db8bd352341 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.509105 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-aee65ede-3db0-4759-91cf-c806ff44a189 req-24cb3688-d2ed-4c4f-ba5f-8db8bd352341 service nova] Creating event network-vif-plugged:6a647d8b-907e-42ff-91de-7ab478625df1 for instance ffdf0e60-fc39-4efd-82dc-737d584be96d on hv-cinder-84986 Jul 14 16:02:22.514420 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-aee65ede-3db0-4759-91cf-c806ff44a189 req-24cb3688-d2ed-4c4f-ba5f-8db8bd352341 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086237 Jul 14 16:02:22.515042 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 325/652] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:22.516483 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:22.517200 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:22.523717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.524762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.525654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.526299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.530528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:22.676850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.684797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d6e5ee41-2a03-4e27-b4a1-3d57bc6d7887 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.173914 Jul 14 16:02:22.685427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 328/653] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:22 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:23.086569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.087539 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.089615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.090278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.095329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.095809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.096624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.097120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.097762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.098214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.098982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.099478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.168366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.176249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc23bd95-8606-4863-b5ff-e1c8d4492f21 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1275 microversion: 2.1 time: 0.094462 Jul 14 16:02:23.179561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 326/654] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:23.263831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.271545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-89fe83a7-19ac-44ca-85e4-3c99ed18b8f4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.185928 Jul 14 16:02:23.272354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 329/655] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:23.702605 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.703217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.709778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.710294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.711147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.711632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.847184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.855544 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21b11ca0-af24-4864-b2b1-0d02477f5de3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1737 microversion: 2.1 time: 0.157564 Jul 14 16:02:23.862266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 327/656] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:24.194337 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.194949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.197242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:24.203047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.203493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.204297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.204734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.269007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:24.276598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-daf332b3-422a-4ae6-a26f-9e634d9abcb5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1275 microversion: 2.1 time: 0.086080 Jul 14 16:02:24.277160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 330/657] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:24.288962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.290265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.297384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.297841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.298618 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.299063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.433442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:24.442401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eeb85846-c380-4f7e-b780-a116ae0d7e4d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.157219 Jul 14 16:02:24.443103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 328/658] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:24.874303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.875076 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.882074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.882523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.883351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.883873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.023263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.031667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-35a79581-ec7f-4aee-b33e-7dc529e0c202 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1717 microversion: 2.1 time: 0.162150 Jul 14 16:02:25.032304 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 331/659] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:25.089363 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.089988 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.092501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:25.098317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.098806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.099653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.100207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.238830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] HTTP exception thrown: Cannot 'detach_volume' instance 4fd3f295-799c-49ef-a570-bfb044012311 while it is in vm_state rescued Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Request method failure captured: Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments/30be4b81-919e-4651-9214-157b077e0545 HTTP/1.1 Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvIzNluMjDp4d3DT5QnvYlw7pRmop_TCGkbaYTQiG5SxYVEGSYRm0dhjXXOMfnm61qx9mJxERTKeTRsuliirCltEJ6xQiwu_JdJxnN2xoKgc1SV0WzqvRAmVBQR9GNIOwARxvOu71BmMHSM1575bPlVIAEYo0-7gIauEqjsC3ZS_o Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:02:25.240525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_2604fe90997b48439ed17360fa15f24a", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}] Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: fe6f58bedd87454bad46b0c48697eec9 Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:02:25.242001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Cannot 'detach_volume' instance 4fd3f295-799c-49ef-a570-bfb044012311 while it is in vm_state rescued Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'server_id': '4fd3f295-799c-49ef-a570-bfb044012311', 'id': '30be4b81-919e-4651-9214-157b077e0545'} Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fd3f295-799c-49ef-a570-bfb044012311 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:02:25.242689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4fd3f295-799c-49ef-a570-bfb044012311 while it is in vm_state rescued Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4fd3f295-799c-49ef-a570-bfb044012311 while it is in vm_state rescued Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:02:25.244626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Returning 409 to user: Cannot 'detach_volume' instance 4fd3f295-799c-49ef-a570-bfb044012311 while it is in vm_state rescued {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:02:25.246252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f2f0c01-12bb-4dd9-8574-467f4ea49c5e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments/30be4b81-919e-4651-9214-157b077e0545" status: 409 len: 152 microversion: 2.1 time: 0.157476 Jul 14 16:02:25.246252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 329/660] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:02:25 2022] DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments/30be4b81-919e-4651-9214-157b077e0545 => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 16:02:25.253151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:25.254294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.265916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.265916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.265916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.266286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.295392 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.297199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.308685 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.309505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.311216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.311780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.392335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.399806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16b00fbc-5bc4-400d-945c-f56ea625d9f8 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1283 microversion: 2.1 time: 0.109111 Jul 14 16:02:25.400402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 330/661] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:25 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:25.459030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.459647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.467275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.467734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.468613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.469082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.488661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:25.606365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.613566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93baa3fa-7f65-4990-82fb-f1a2711d47f3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/action" status: 202 len: 0 microversion: 2.1 time: 0.365654 Jul 14 16:02:25.621403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 332/662] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:02:25 2022] POST /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:02:25.621543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42b33120-d53c-4fc3-93e0-22ef062655f6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.159533 Jul 14 16:02:25.621543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 331/663] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:25 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:25.623571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.624440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.631064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.631530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.632311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.632747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.772156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.781909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5845c075-b63f-43d0-94be-abca62820033 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.163063 Jul 14 16:02:25.782476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 333/664] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:25 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:26.417727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:26.418525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:26.425378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.426078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.426842 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.427307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.504394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.512551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58e3b8e2-4d37-4165-a0dd-b73c09a6b086 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1281 microversion: 2.1 time: 0.098982 Jul 14 16:02:26.513574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 332/665] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:26 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:26.631824 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:26.632464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:26.639448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.639895 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.640680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.641135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.800385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:26.807198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:26.807578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.808032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.808854 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.809293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.917178 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.925487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac993dec-35f7-4b10-a718-1100393e78a2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1269 microversion: 2.1 time: 0.297483 Jul 14 16:02:26.926610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 334/666] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:26 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:26.981480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.990169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-98833584-ad44-4be7-9839-5945cd0cd647 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.194506 Jul 14 16:02:26.991046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 333/667] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:26 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:27.530799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:27.531416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:27.537661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.538116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.538884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.539319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.678857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:27.686957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-21558a3a-7a6c-4246-b3f8-bc74052c892b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.160553 Jul 14 16:02:27.687518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 335/668] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:27 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:27.942609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:27.943300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:27.950046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.950490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.951826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.952288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.012091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:28.012091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.014844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.015306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.016093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.016584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.183145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.194041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-50206721-172a-4a86-92b9-d2d3366a1b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1456 microversion: 2.1 time: 0.255174 Jul 14 16:02:28.194926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 334/669] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:27 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1456 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:28.257061 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.267910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc7efb06-1b96-4734-b8a3-49ceb077328a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.264314 Jul 14 16:02:28.268914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 336/670] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:28 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:28.274785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:28.275499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.282625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.283368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.284411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.285050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.291851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-797c217d-ae46-4da8-9065-161fff27ffbb req-55ce97fa-56e2-4f92-a759-eacacb129b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ba16d2-b8e0-4d0d-81c3-043b26c64a13", "tag": "a5b5b9ff-af39-4b0e-9608-d03cc9367d89"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:28.302755 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-797c217d-ae46-4da8-9065-161fff27ffbb req-55ce97fa-56e2-4f92-a759-eacacb129b35 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.303252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-797c217d-ae46-4da8-9065-161fff27ffbb req-55ce97fa-56e2-4f92-a759-eacacb129b35 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.318645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-797c217d-ae46-4da8-9065-161fff27ffbb req-55ce97fa-56e2-4f92-a759-eacacb129b35 service nova] Creating event network-changed:a5b5b9ff-af39-4b0e-9608-d03cc9367d89 for instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 on hv-cinder-84986 Jul 14 16:02:28.323678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-797c217d-ae46-4da8-9065-161fff27ffbb req-55ce97fa-56e2-4f92-a759-eacacb129b35 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127348 Jul 14 16:02:28.324669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 335/671] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:28.440625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.448588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b690faf2-8916-4ed1-8c3c-e69c93033b10 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1456 microversion: 2.1 time: 0.178410 Jul 14 16:02:28.449455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 337/672] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:28 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1456 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:28.705141 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:28.705966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.708087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:28.708825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:28.714564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.715046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.715805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.716294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.936368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.944310 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e59e6552-714d-4534-8d96-85c99990f651 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.243996 Jul 14 16:02:28.944960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 336/673] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:28 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:29.285930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:29.287423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:29.294341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:29.297171 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.298362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.299398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.300214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.524746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:29.533607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-76db108e-693b-4e22-8bc4-7e81ece69feb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.251639 Jul 14 16:02:29.543180 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 338/674] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:29 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:29.960851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:29.961441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:29.969255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.969713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.970492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.970931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.134684 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:30.143086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-db1cc292-3ef0-4337-8243-dfa20cb7211e tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.186193 Jul 14 16:02:30.143591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 337/675] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:29 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:30.550683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:30.551390 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:30.558462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.559153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.559930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.560433 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.001695 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:31.009903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dfd07f0d-71d6-4daa-b276-ac54d73007eb tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.463109 Jul 14 16:02:31.010472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 339/676] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:30 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:31.075460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2a80b4fd-8100-4b85-80ca-1ea372fcf5ab req-d7bbdf04-8026-4922-856a-4fa8b85e5518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdf0e60-fc39-4efd-82dc-737d584be96d", "tag": "6a647d8b-907e-42ff-91de-7ab478625df1"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:31.084471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a80b4fd-8100-4b85-80ca-1ea372fcf5ab req-d7bbdf04-8026-4922-856a-4fa8b85e5518 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.084918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a80b4fd-8100-4b85-80ca-1ea372fcf5ab req-d7bbdf04-8026-4922-856a-4fa8b85e5518 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.097761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2a80b4fd-8100-4b85-80ca-1ea372fcf5ab req-d7bbdf04-8026-4922-856a-4fa8b85e5518 service nova] Creating event network-changed:6a647d8b-907e-42ff-91de-7ab478625df1 for instance ffdf0e60-fc39-4efd-82dc-737d584be96d on hv-cinder-84986 Jul 14 16:02:31.102716 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2a80b4fd-8100-4b85-80ca-1ea372fcf5ab req-d7bbdf04-8026-4922-856a-4fa8b85e5518 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030862 Jul 14 16:02:31.103474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 338/677] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:31.160199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:31.160807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:31.167004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.167470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.168305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.168786 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.301351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:31.309567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3d4c118f-2c08-41b8-95ac-5316e69573bd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.153162 Jul 14 16:02:31.310454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 340/678] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:31 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:32.027358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:32.028116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.035024 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.035402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.036250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.036684 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.172281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.180600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e44f7cbd-a82d-478a-893b-100460f8665c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.157417 Jul 14 16:02:32.181181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 339/679] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:32 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:32.327514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:32.328052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.334218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.334661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.335415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.335845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.463451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.470951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b3b4eff-8499-468e-8511-6affa4b38eb1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.148198 Jul 14 16:02:32.471725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 341/680] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:32 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:33.198008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:33.198551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:33.205290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.205740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.206506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.206943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.342629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.350759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1685342d-c554-4ed2-a8c4-37f442fced9c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1725 microversion: 2.1 time: 0.156850 Jul 14 16:02:33.351328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 340/681] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:33 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:33.488333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:33.488898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:33.495429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.495871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.496667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.497102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.628623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.636027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-edc2ee1c-dbcc-4914-9b6c-647d84d36713 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.151701 Jul 14 16:02:33.636622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 342/682] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:33 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:34.368814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.369361 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.377006 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.377457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.378245 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.378699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.512426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.521866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4436222-47cf-4f1b-a713-5ca111d6f13b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1731 microversion: 2.1 time: 0.157021 Jul 14 16:02:34.522454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 341/683] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:34.542618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.543103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.550205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.550645 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.551405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.551838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.627781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1c43eda-d179-47b7-9f7a-a12339a53596 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088954 Jul 14 16:02:34.628420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 343/684] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:34.709420 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.710034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.716284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.716929 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.717703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.718140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.966077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.973560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5aab20be-1f52-4e15-80d0-17689d29370b tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.267944 Jul 14 16:02:34.974324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 342/685] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:35.643283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-f74bda93-f69e-4bbd-83f6-df0908de98d2 req-d642a3e1-0cb8-43f9-86e6-f47d98400990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:35.654508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f74bda93-f69e-4bbd-83f6-df0908de98d2 req-d642a3e1-0cb8-43f9-86e6-f47d98400990 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.655927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f74bda93-f69e-4bbd-83f6-df0908de98d2 req-d642a3e1-0cb8-43f9-86e6-f47d98400990 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.661820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:35.672947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-f74bda93-f69e-4bbd-83f6-df0908de98d2 req-d642a3e1-0cb8-43f9-86e6-f47d98400990 service nova] Creating event network-changed:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 16:02:35.678168 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-f74bda93-f69e-4bbd-83f6-df0908de98d2 req-d642a3e1-0cb8-43f9-86e6-f47d98400990 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038704 Jul 14 16:02:35.678855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 344/686] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:35.989838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:35.990449 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:35.997107 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.997563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.998384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.998811 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.132244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.140419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ee56d184-d964-47dd-9339-987c608fbd72 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.154641 Jul 14 16:02:36.140996 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 343/687] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:35 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:37.159145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.159874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.166889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.167334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.168202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.168652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.300910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.308275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cf84754-d59d-4651-b548-9066b41304a5 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.154699 Jul 14 16:02:37.308848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 345/688] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:37.692688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-b8a1a926-b8ca-4c57-943f-f4c763019870 req-ab3b49d5-b9b4-4e67-9f59-81b4cd2706e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:37.701328 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b8a1a926-b8ca-4c57-943f-f4c763019870 req-ab3b49d5-b9b4-4e67-9f59-81b4cd2706e6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.701767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b8a1a926-b8ca-4c57-943f-f4c763019870 req-ab3b49d5-b9b4-4e67-9f59-81b4cd2706e6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.712601 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-b8a1a926-b8ca-4c57-943f-f4c763019870 req-ab3b49d5-b9b4-4e67-9f59-81b4cd2706e6 service nova] Creating event network-changed:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 16:02:37.718153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-b8a1a926-b8ca-4c57-943f-f4c763019870 req-ab3b49d5-b9b4-4e67-9f59-81b4cd2706e6 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029140 Jul 14 16:02:37.718721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 344/689] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:38.329677 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:38.331391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:38.339771 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.340746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.342600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.343021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.488068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:38.496557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82b1fa03-efc2-4225-a228-32d0a5e59688 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.174151 Jul 14 16:02:38.497126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 346/690] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:38 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:39.516340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.517093 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.523804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.524218 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.524987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.525441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.655747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.663158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c745d5c-66af-4a5d-b561-fe10048d03d1 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.152341 Jul 14 16:02:39.663724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 345/691] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:40.680459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:40.681071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:40.688052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.688536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.689300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.689738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.816027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:40.823308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba18e045-d409-43a2-9d77-34dca0b4e054 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.146893 Jul 14 16:02:40.823875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 347/692] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:40 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:41.151393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-3e30f788-4b0c-4613-b8eb-1e7dcea65fa7 req-5eb8d2bb-7ad4-490d-ae11-086e86a9bcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ba16d2-b8e0-4d0d-81c3-043b26c64a13", "name": "network-vif-plugged", "status": "completed", "tag": "a5b5b9ff-af39-4b0e-9608-d03cc9367d89"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:41.161043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3e30f788-4b0c-4613-b8eb-1e7dcea65fa7 req-5eb8d2bb-7ad4-490d-ae11-086e86a9bcb4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.161482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3e30f788-4b0c-4613-b8eb-1e7dcea65fa7 req-5eb8d2bb-7ad4-490d-ae11-086e86a9bcb4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.174961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-3e30f788-4b0c-4613-b8eb-1e7dcea65fa7 req-5eb8d2bb-7ad4-490d-ae11-086e86a9bcb4 service nova] Creating event network-vif-plugged:a5b5b9ff-af39-4b0e-9608-d03cc9367d89 for instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 on hv-cinder-84986 Jul 14 16:02:41.179640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-3e30f788-4b0c-4613-b8eb-1e7dcea65fa7 req-5eb8d2bb-7ad4-490d-ae11-086e86a9bcb4 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 Jul 14 16:02:41.180323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 346/693] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:41.840941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:41.841714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:41.848192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.848651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.849446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.849888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.984708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:41.991972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-300bfa71-50e0-4c9c-8efa-b99061c1bd74 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.155232 Jul 14 16:02:41.992561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 348/694] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:41 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:43.010342 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:43.011038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.017291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.017739 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.018505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.018994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.146910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:43.154863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc20329f-2ae4-42dc-9131-aaa124691a34 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.148598 Jul 14 16:02:43.155433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 347/695] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:43 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:44.172475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:44.173093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:44.179625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.180080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.180876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.181316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.317877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:44.325290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f889346f-09cd-485b-a1fa-a6b97859e113 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1323 microversion: 2.1 time: 0.157377 Jul 14 16:02:44.331262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 349/696] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:44 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:45.346289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:45.346898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:45.353396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.353842 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.354599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.355027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.486747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:45.494281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-528fe3be-7667-4223-b0c1-d75cb5274a3a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1512 microversion: 2.1 time: 0.151942 Jul 14 16:02:45.494879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 348/697] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:45 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:45.510510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5182002a-70de-4b73-8a61-5aeccdd5c15e", "device": "/dev/sdb"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:45.512203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:45.518687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.519134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.519903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.520370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.375830 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1c006e8-08cd-4a0f-9b32-d26bf3e0ce98 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "POST /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869015 Jul 14 16:02:46.376492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 350/698] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:02:45 2022] POST /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:57.328488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:57.330035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.332194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=39 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.332858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=88 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.338170 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.343932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.343932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.343932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.616127 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b151a00b-130b-48d9-8107-084ca59d2b77 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action" status: 202 len: 0 microversion: 2.1 time: 0.291518 Jul 14 16:02:57.617030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 349/699] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:02:57 2022] POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:02:57.622771 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=41 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.623597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.628374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:57.629077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.635177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.635624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.636420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.636859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.781175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:57.789850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b44eb56-2c47-4552-903a-f96a572848f6 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1755 microversion: 2.1 time: 0.168654 Jul 14 16:02:57.790477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 351/700] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:57 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:58.810196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:58.810817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:58.817781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.818228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.819098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.819536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.966240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:58.974889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d2ab1840-f9d1-493c-b455-246f6162c21e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1755 microversion: 2.1 time: 0.169429 Jul 14 16:02:58.975450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 350/701] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:58 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:59.991762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.992520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.999567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.000019 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.007462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.007462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.145430 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:00.153258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f73f4cd1-13b7-4901-98af-63f0c6e934eb tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1755 microversion: 2.1 time: 0.165931 Jul 14 16:03:00.153825 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 352/702] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:01.170170 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:01.170810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:01.177526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.177969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.178726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.179161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.322103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:01.330198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ecda1a6a-0a34-4171-8fa2-47060be7291f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1755 microversion: 2.1 time: 0.163917 Jul 14 16:03:01.330758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 351/703] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:01 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:02.349354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.349974 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:02.356577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.357028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.357791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.358231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.501029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:02.509188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4365ba4-afde-4a10-a878-d08519e5040c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1755 microversion: 2.1 time: 0.165041 Jul 14 16:03:02.509763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 353/704] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:02 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:03.526565 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:03.531921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:03.534039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.534566 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.535451 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.535885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.696458 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:03.704263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-225d7427-3996-4a9b-80a8-725e42fc6189 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.181903 Jul 14 16:03:03.704829 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 352/705] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:03 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:04.722018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:04.723278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:04.729602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.730050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.730808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.731246 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.870609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:04.878445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b0e6b9d8-2a59-420a-ab72-64f1bc9bd87f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.160341 Jul 14 16:03:04.879010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 354/706] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:04 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:05.895446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:05.896052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:05.902773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.903209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.904025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.904484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.046759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:06.055672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a5de285-f2ac-4f82-8fd8-d48cc12f7019 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.164182 Jul 14 16:03:06.056322 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 353/707] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:05 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:07.072661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:07.073262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:07.079929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.080413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.081170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.081626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.226367 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:07.234343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bee9253d-a094-4958-a8a6-d821a984aced tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.165462 Jul 14 16:03:07.234907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 355/708] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:07 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:08.250734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:08.251348 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:08.258765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.259210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.259968 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.260437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.409500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:08.418174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56eba373-ea1b-4def-bcc4-23b5aa7d9c18 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.171337 Jul 14 16:03:08.420226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 354/709] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:08 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:09.435677 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.436315 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.443590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.444036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.444823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.445255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.589935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:09.598175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-262ab202-40be-457b-a46f-097fc8d44e2e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.166380 Jul 14 16:03:09.598748 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 356/710] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:09.947089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.947586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.953558 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.954010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.954777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.955214 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.034257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lazy-loading 'services' on Instance uuid 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:10.313862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f7a6bed9-511e-4f33-b1c7-85c3f4627814 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments/f78aa7a0-f440-4558-b156-419cab8b53d9" status: 202 len: 0 microversion: 2.1 time: 0.472406 Jul 14 16:03:10.314461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 355/711] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:03:09 2022] DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments/f78aa7a0-f440-4558-b156-419cab8b53d9 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:10.614560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.615139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.621644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.622096 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.622855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.623292 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.767128 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:10.775658 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7dd315c3-99a7-4300-81aa-c8f5cd0eb207 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.165188 Jul 14 16:03:10.776252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 357/712] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:11.793798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.794559 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.800862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.801317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.802070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.802508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.946657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:11.955085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d9ba177-aa41-4afd-a9e7-f54bbb77385e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.165872 Jul 14 16:03:11.961477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 356/713] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:12.517000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-115dc59d-7480-401a-8b87-bb31610e9c49 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:12.524331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-115dc59d-7480-401a-8b87-bb31610e9c49 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.524791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-115dc59d-7480-401a-8b87-bb31610e9c49 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.555424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-115dc59d-7480-401a-8b87-bb31610e9c49 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Going to try to stop instance {{(pid=125267) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 16:03:12.717331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-115dc59d-7480-401a-8b87-bb31610e9c49 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action" status: 202 len: 0 microversion: 2.1 time: 0.204140 Jul 14 16:03:12.718012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 358/714] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:03:12 2022] POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:12.726182 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.726717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.732991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.733437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.734207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.734753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.873316 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.881394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a33228d-4870-43cc-9054-265fb898ae02 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.159212 Jul 14 16:03:12.881957 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 357/715] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:12.975669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.976455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.982630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.983110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.983873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.984343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.128220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.136044 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-460fc027-f567-4114-a049-c0156bea7384 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.165073 Jul 14 16:03:13.136639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 359/716] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:13.898719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.899330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.906454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.906933 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.907747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.908203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.042731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.049576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8d4af7a-b0f1-4831-ae3d-0987f0d60f44 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.154895 Jul 14 16:03:14.050142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 358/717] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:14.160553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.161304 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.167799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.168282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.169053 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.169492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.313505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.321637 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fb4c9fe-38a1-4545-a675-bac6ff5425b2 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.164994 Jul 14 16:03:14.322258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 360/718] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:14 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:14.773645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.774157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.780199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.780642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.781398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.781896 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.861262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lazy-loading 'services' on Instance uuid 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:15.070505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.070505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.075006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.075457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.076455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.076897 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.163964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1be773c-17c6-4e30-bfb6-c4a8a1ac7361 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "DELETE /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13/os-volume_attachments/5182002a-70de-4b73-8a61-5aeccdd5c15e" status: 202 len: 0 microversion: 2.1 time: 0.394639 Jul 14 16:03:15.164756 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 359/719] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:03:14 2022] DELETE /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13/os-volume_attachments/5182002a-70de-4b73-8a61-5aeccdd5c15e => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:15.220844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:15.228659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-34f4665e-04fd-4149-882b-00292a57d5df tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.165147 Jul 14 16:03:15.229228 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 361/720] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:15.339647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.340493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.346809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.347251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.348083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.349147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.499966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:15.508077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a94c112f-0768-40c0-bff4-ddbc4fa08a39 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.173054 Jul 14 16:03:15.508673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 360/721] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:15.919553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:03:15.919723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:03:16.246283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.248228 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.253910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.254484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.257887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.258567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.389657 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:16.397628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e49fd2b0-134b-4027-aa6b-da08fac21117 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.155399 Jul 14 16:03:16.398201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 362/722] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:16.525296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.525914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.532601 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.533055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.533825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.534291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.680494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:16.688602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4413b7af-080f-46e0-aa51-9ced52dbd766 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.167225 Jul 14 16:03:16.689326 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 361/723] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:17.334912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.335459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.342108 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.342550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.343303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.343734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.368996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:17.415242 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.415856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.421850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.422293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.423140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.423563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.551078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:17.559260 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-272a0366-63f8-4860-9fdd-09d3504a7f88 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.148497 Jul 14 16:03:17.559826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 362/724] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:17.705623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.706258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.712374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.713076 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.713920 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.714417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.718636 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:17.859678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:17.869243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61ea1321-1ab4-4385-a9ce-ceb4ce09bcea tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.167378 Jul 14 16:03:17.869941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 363/725] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:17.902961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d19170a3-cb5a-4787-a53b-8b3b8efd7019 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "DELETE /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 204 len: 0 microversion: 2.1 time: 0.571584 Jul 14 16:03:17.903557 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 363/726] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:03:17 2022] DELETE /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:03:17.911599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.912258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.919942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.919942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.919942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.920275 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.049630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:18.057801 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20eb1bd6-8b81-4e4f-b6a7-92565c520e1a tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1518 microversion: 2.1 time: 0.150065 Jul 14 16:03:18.058374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 364/727] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:18.576674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.577465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.584662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.585103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.585884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.586321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.717539 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:18.721136 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:18.725482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4c49cf0d-e66e-47da-b242-25b7b7455987 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.153139 Jul 14 16:03:18.728842 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 364/728] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:18.886900 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.887508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.894432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.894897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.895777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.896246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.041517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.049617 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e04a92fc-604c-4d05-b99a-771e4f11aae4 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.166648 Jul 14 16:03:19.050177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 365/729] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:19.074714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.075327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.081987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.082440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.083724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.084199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.224755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.232286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a683ab2e-0a33-4cc7-bfd3-92f8c0dd59b3 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1518 microversion: 2.1 time: 0.161343 Jul 14 16:03:19.232781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 365/730] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:19.743457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.744071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.751032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.751466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.752270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.752693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.881810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.889252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a3111905-a5a1-4dea-842a-91a5be5ec244 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.150324 Jul 14 16:03:19.889841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 366/731] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:20.069905 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.070532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.077374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.079226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.080008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.080553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.231671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:20.239717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb291ad1-4f99-41ec-b08a-0ee014d095d1 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.176733 Jul 14 16:03:20.240308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 366/732] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:20.250203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.250599 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.258227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.258672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.259509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.259975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.420184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:20.428222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ade55e0a-0d85-4354-8c51-b00161bee956 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1518 microversion: 2.1 time: 0.182175 Jul 14 16:03:20.428813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 367/733] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:20.907537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.908201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.915159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.915603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.916427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.916884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.050181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.060258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9f66ed0-4720-40d8-ac4d-98345bbbb72f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.156483 Jul 14 16:03:21.060841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 367/734] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.257097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.257704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.264299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.264743 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.265509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.265938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.408932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.417884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1125f14-f831-441d-9e23-3a918121bfee tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.165036 Jul 14 16:03:21.418511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 368/735] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.445115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.445719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.452504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.452982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.453781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.454284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.529510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.539489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-370dd3ea-6a01-479e-9e1a-1833b6f09cbd tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1476 microversion: 2.1 time: 0.098194 Jul 14 16:03:21.540121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 368/736] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1476 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.617607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-0c688773-f069-4f0c-a087-d499f78af77e req-28503e90-26e8-4d98-8401-d76467b6ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ba16d2-b8e0-4d0d-81c3-043b26c64a13", "name": "network-vif-deleted", "tag": "a5b5b9ff-af39-4b0e-9608-d03cc9367d89"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:21.625782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0c688773-f069-4f0c-a087-d499f78af77e req-28503e90-26e8-4d98-8401-d76467b6ed6e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.633094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0c688773-f069-4f0c-a087-d499f78af77e req-28503e90-26e8-4d98-8401-d76467b6ed6e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.637411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-0c688773-f069-4f0c-a087-d499f78af77e req-28503e90-26e8-4d98-8401-d76467b6ed6e service nova] Creating event network-vif-deleted:a5b5b9ff-af39-4b0e-9608-d03cc9367d89 for instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 on hv-cinder-84986 Jul 14 16:03:21.642459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-0c688773-f069-4f0c-a087-d499f78af77e req-28503e90-26e8-4d98-8401-d76467b6ed6e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081491 Jul 14 16:03:21.643176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 369/737] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:22.078284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.078988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.086257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.086646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.087502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.088341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.218373 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:22.225948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68b79a2b-7713-44b1-b20e-7eb133db7871 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.151844 Jul 14 16:03:22.226529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 369/738] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:22.435983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.436610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.443588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.444412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.444812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.445248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.562893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.563566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.570042 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.570488 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.571305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.571733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.589038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:22.597254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7a4cf4c8-283d-4c81-bffc-1cc6e4649d74 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.166073 Jul 14 16:03:22.597841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 370/739] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:22.603864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.604505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.604949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lazy-loading 'fault' on Instance uuid 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:22.651045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891f70cc0e34e1f98116dec9c09cc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02d8a2f826a4475982abb77ccc636f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:22.655705 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-247af4f8-fadb-4c71-ad08-08ae09cd3a30 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 200 len: 1313 microversion: 2.1 time: 0.096833 Jul 14 16:03:22.656290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 370/740] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 1313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:23.243581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.244212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.250308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.250757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.251520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.251957 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.390063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.398346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4b4ab469-5d51-46e3-be9c-42563c960739 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.159125 Jul 14 16:03:23.401101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 371/741] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:23.616836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.617517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.623901 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.624408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.625188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.625627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.673319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.674064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] [instance: 30ba16d2-b8e0-4d0d-81c3-043b26c64a13] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.680845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.681293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.682052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.682651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] HTTP exception thrown: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Request method failure captured: Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 HTTP/1.1 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D2EuS5MW-_Gib95PDRpJFNJ5ZDMppw_no-LpRm7zXWoJ1r9HeOG3Osf_VOD65MBV-lEEtpIzzzGcsdlLHI3os9b9MY-G_tzhjH-zOZzxizpJxIqyEr4QGJhHP56Pij0Az48Crs-ug1nKw0yxKg0VODWDsWkcl8Uku5LVLkIo26cixA Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: a02d8a2f826a4475982abb77ccc636f5 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:03:23.706302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a02d8a2f826a4475982abb77ccc636f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/a02d8a2f826a4475982abb77ccc636f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_a02d8a2f826a4475982abb77ccc636f5", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/a02d8a2f826a4475982abb77ccc636f5"}]}] Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: a02d8a2f826a4475982abb77ccc636f5 Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1279572182 Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotTestJSON-1279572182-project Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: f891f70cc0e34e1f98116dec9c09cc5f Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotTestJSON-1279572182-project Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. Jul 14 16:03:23.709359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '30ba16d2-b8e0-4d0d-81c3-043b26c64a13'} Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:23.710257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. Jul 14 16:03:23.711734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.713591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] Returning 404 to user: Instance 30ba16d2-b8e0-4d0d-81c3-043b26c64a13 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:23.713591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-589534dd-170d-460e-90ad-a6258434d999 tempest-VolumesSnapshotTestJSON-1279572182 tempest-VolumesSnapshotTestJSON-1279572182-project] 10.222.0.119 "GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13" status: 404 len: 111 microversion: 2.1 time: 0.030809 Jul 14 16:03:23.713591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 372/742] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/30ba16d2-b8e0-4d0d-81c3-043b26c64a13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:03:23.793572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.802742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b175828e-0cf6-4b9b-a57a-68cb5c78d62e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.191202 Jul 14 16:03:23.803324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 371/743] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:24.415570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:24.416198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:24.422258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.422704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.423463 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.423928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.556331 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.563824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65fb0edc-fc62-401b-b828-d6fb6b13c220 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.153001 Jul 14 16:03:24.564412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 373/744] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:24 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:24.820093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:24.820723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:24.827148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.827602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.828386 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.828823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.970979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.980853 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4771eb37-376a-4a2c-9975-ee92f5e73274 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.164890 Jul 14 16:03:24.981452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 372/745] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:24 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:25.580183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:25.580839 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:25.588332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.588789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.589627 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.590022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.879611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:25.889002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a9e5b53-1232-4191-bad1-8ef0f14d6c1e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.312680 Jul 14 16:03:25.889571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 374/746] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:25 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:25.998848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:25.999458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:26.006299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.006861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.007629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.008231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.150800 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:26.159093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc346cc0-1045-4bf3-9be4-77b6a1b6a140 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1760 microversion: 2.1 time: 0.164112 Jul 14 16:03:26.159770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 373/747] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:25 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:26.908826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:26.909434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:26.915611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.916062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.916878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.917519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:27.049197 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:27.057568 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1aaec6cd-a00b-466e-a5a5-b43354a06712 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.152615 Jul 14 16:03:27.058123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 375/748] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:26 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:27.176223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:27.176773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:27.183816 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:27.184306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:27.185069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:27.185505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:27.326021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:27.334889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-863feb43-b242-4cd5-8a7c-ef82e1ba605d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1763 microversion: 2.1 time: 0.162464 Jul 14 16:03:27.335565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 374/749] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:27 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1763 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:28.075794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:28.076429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:28.078881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=55 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:28.083727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.084213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.084980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.085417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.212724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:28.220393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-08df1535-36a2-44c2-a290-ab663b0e023b tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.148466 Jul 14 16:03:28.220954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 376/750] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:28 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:29.238555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:29.239097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:29.242104 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:29.247132 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.247581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.248412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.248846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.381216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:29.388712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-11467e94-4246-40f7-b144-0c7940a63648 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.154111 Jul 14 16:03:29.389290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 375/751] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:29 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:30.406016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:30.406620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:30.416109 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.417240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.418349 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.418861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.547484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:30.555462 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3cd1d930-3df5-44ce-aa70-df685cde2253 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1682 microversion: 2.1 time: 0.153433 Jul 14 16:03:30.556022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 377/752] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:30 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:31.573253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:31.573862 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:31.579997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.580477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.581237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.581673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.714008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:31.721579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4eb3a9e4-f818-4633-822d-724f7b969191 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1659 microversion: 2.1 time: 0.152527 Jul 14 16:03:31.722179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 376/753] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:31 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1659 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:31.737817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc13933f-9368-420a-a68d-88c9b656b0d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:31.751971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc13933f-9368-420a-a68d-88c9b656b0d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.751971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc13933f-9368-420a-a68d-88c9b656b0d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.767281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc13933f-9368-420a-a68d-88c9b656b0d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Going to try to start instance {{(pid=125266) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 16:03:32.003352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc13933f-9368-420a-a68d-88c9b656b0d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action" status: 202 len: 0 microversion: 2.1 time: 0.269157 Jul 14 16:03:32.003946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 378/754] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:03:31 2022] POST /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:32.012802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:32.013419 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:32.020169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.020845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.021345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.021833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.156017 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:32.164330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bc6fca6-9243-417e-9e8d-e030b5d4ae66 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1668 microversion: 2.1 time: 0.155611 Jul 14 16:03:32.164904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 377/755] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:32 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:33.182652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.183348 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:33.189513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.189954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.190702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.191128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.325032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:33.332732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3af5a135-7e1f-4c86-880e-7c1f674a7a0a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1668 microversion: 2.1 time: 0.154830 Jul 14 16:03:33.333356 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 379/756] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:33 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:34.350862 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:34.351477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:34.357936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.358383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.359149 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.359585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.492240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:34.499899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fa13ea9d-b0b7-4670-965a-a55e1a13d5e1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1672 microversion: 2.1 time: 0.153597 Jul 14 16:03:34.503359 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 378/757] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:34 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:40.196630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:40.197142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.203142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.203594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.204411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.204855 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.209098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:40.232238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4dcb2cef-8418-4939-bdba-4daaffb29549 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/ips" status: 200 len: 149 microversion: 2.1 time: 0.137646 Jul 14 16:03:40.232787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 380/758] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:03:40 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/ips => generated 149 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:40.243545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e29113b7-0259-40e8-9347-8264ed2b804d"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:40.244784 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.251282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.251735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.252542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.252981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.331327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/os-volume_attachments HTTP/1.1 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 74 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:03:40.333095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {"volumeAttachment": {"volumeId": "e29113b7-0259-40e8-9347-8264ed2b804d"}} Jul 14 16:03:40.335289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'server_id': '049a39c1-4f3d-4d0b-9363-90141a78f8da', 'body': {'volumeAttachment': {'volumeId': 'e29113b7-0259-40e8-9347-8264ed2b804d'}}} Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:40.336346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:40.337738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 400 to user: Invalid volume: volume e29113b7-0259-40e8-9347-8264ed2b804d is already attached to instances: 41756c6f-5714-4b75-b3fb-ee75edcac924 {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a3048177-10b8-46b0-aeb9-349b9fd1e046 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095906 Jul 14 16:03:40.339606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 379/759] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:03:40 2022] POST /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:40.344308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:40.344812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.352318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.352661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.353427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.353867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.378960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:40.828949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28fdc05c-b426-48d4-8988-1ff383bafcb1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 204 len: 0 microversion: 2.1 time: 0.488157 Jul 14 16:03:40.829540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 381/760] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:03:40 2022] DELETE /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:03:40.840038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:40.840707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.847781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.848266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.849298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.849822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.978169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:40.985734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f0987415-4332-4448-a1a8-d281185d99a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.150619 Jul 14 16:03:40.986291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 380/761] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:40 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:42.003602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:42.004429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:42.011351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.011841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.012651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.013095 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.147828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:42.156507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dcefd023-8a8d-4cd9-a0d0-4ab0f26a5ed7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.157269 Jul 14 16:03:42.157084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 382/762] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:41 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:43.175770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:43.176448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:43.183055 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.183505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.184284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.184717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.188619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:43.314236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:43.322754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-abaeb97b-7652-4dda-bc61-2d1767f5af28 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.150949 Jul 14 16:03:43.323324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 381/763] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:43 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:44.340685 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:44.341294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:44.347838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.348325 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.349084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.349661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.481630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:44.489309 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf40351a-cd45-43f0-a7d2-dce64afdc868 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.152830 Jul 14 16:03:44.489877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 383/764] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:44 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:45.510450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.510450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:45.520091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.520884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.521354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.522010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.657458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:45.665689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c149653-7e1d-4a66-a990-b1293bec9918 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.162844 Jul 14 16:03:45.666262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 382/765] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:45 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:46.682678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.683324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:46.689835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.690280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:46.691041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.691477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:46.823799 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:46.831312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-74d68834-05cb-4621-aa6e-84ec4fd4ce8f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1683 microversion: 2.1 time: 0.152547 Jul 14 16:03:46.831872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 384/766] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:46 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:47.850651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:47.851337 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:47.859639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:47.860127 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:47.860929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:47.861366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:47.941360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:47.950465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8727706d-1f23-4a4f-bdb6-2a24e0b2e409 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1616 microversion: 2.1 time: 0.104623 Jul 14 16:03:47.952193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 383/767] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:47 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1616 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:48.106648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c484056a-9db3-42e6-9e9e-2db9514fb3b3 req-35384823-af7b-4d1b-bc12-e3c5645598b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049a39c1-4f3d-4d0b-9363-90141a78f8da", "name": "network-vif-deleted", "tag": "da04afde-49ca-4d22-a6e3-9e21925af059"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:48.115210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c484056a-9db3-42e6-9e9e-2db9514fb3b3 req-35384823-af7b-4d1b-bc12-e3c5645598b8 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.115919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c484056a-9db3-42e6-9e9e-2db9514fb3b3 req-35384823-af7b-4d1b-bc12-e3c5645598b8 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.130314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c484056a-9db3-42e6-9e9e-2db9514fb3b3 req-35384823-af7b-4d1b-bc12-e3c5645598b8 service nova] Creating event network-vif-deleted:da04afde-49ca-4d22-a6e3-9e21925af059 for instance 049a39c1-4f3d-4d0b-9363-90141a78f8da on hv-cinder-84986 Jul 14 16:03:48.136002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c484056a-9db3-42e6-9e9e-2db9514fb3b3 req-35384823-af7b-4d1b-bc12-e3c5645598b8 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Jul 14 16:03:48.136801 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 385/768] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:48.968977 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:48.969631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:48.977442 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.977892 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.978855 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.979294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.016589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:49.017041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.017493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'fault' on Instance uuid 049a39c1-4f3d-4d0b-9363-90141a78f8da {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:49.073024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:49.087474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23cccdb0-be08-4279-8e23-7e1ce669e076 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 200 len: 1334 microversion: 2.1 time: 0.122269 Jul 14 16:03:49.088062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 384/769] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:48 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 1334 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:50.106455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:50.107343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:50.113664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.114116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.114890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.116386 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.133615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da HTTP/1.1 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:03:50.137588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:03:50.138919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '049a39c1-4f3d-4d0b-9363-90141a78f8da'} Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:50.139823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:03:50.141810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:03:50.143276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:50.143276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-698e0042-8ffc-4de5-908f-2f9485574dc4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 404 len: 111 microversion: 2.1 time: 0.035186 Jul 14 16:03:50.143276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 386/770] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:50 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:50.146470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fff8da5b-f2c7-4611-8f6d-908b3dc6e75a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '.version_select at 0x7f0dc1e56dc0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:50.243566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fff8da5b-f2c7-4611-8f6d-908b3dc6e75a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74945037" status: 202 len: 0 microversion: 2.1 time: 0.101159 Jul 14 16:03:50.244297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 385/771] 10.222.0.119 () {58 vars in 1219 bytes} [Thu Jul 14 16:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74945037 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:51.258641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:51.259199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:51.265710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.266159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.266978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.267414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.350366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'services' on Instance uuid 41756c6f-5714-4b75-b3fb-ee75edcac924 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:51.656556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ba3cd65-3f5c-416c-90ae-b64f1a12a2ba tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments/e29113b7-0259-40e8-9347-8264ed2b804d" status: 202 len: 0 microversion: 2.1 time: 0.402069 Jul 14 16:03:51.657284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 387/772] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:03:51 2022] DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments/e29113b7-0259-40e8-9347-8264ed2b804d => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:51.666790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:51.667813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:51.674545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.674999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.675778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.676255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.705895 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c5e4f88-3faf-43b4-80a7-bb14847264b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Jul 14 16:03:51.706583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 386/773] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:03:51 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:52.718266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:52.719318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:52.726495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:52.726946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:52.727705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:52.728163 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:52.758357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-36d0939c-0642-4671-b5e7-b63def8474be tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Jul 14 16:03:52.759054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 388/774] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:03:52 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:53.770471 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:53.771345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:53.778038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.778486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.779250 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.779686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.808069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4db390db-680a-4cd7-b452-2644af101cc8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042049 Jul 14 16:03:53.808649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 387/775] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:03:53 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:03:53.866777 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:53.867300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:53.873771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.874216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.874975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.875409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.903405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:54.309060 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b1dcaaa-eb47-42cc-86f5-828aa773f262 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 204 len: 0 microversion: 2.1 time: 0.446290 Jul 14 16:03:54.309573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 389/776] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:03:53 2022] DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:03:54.317629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:54.322600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:54.324774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.325220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.325975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.326408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.460555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:54.468318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f385834-3098-46ae-8b62-b81a13672644 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1685 microversion: 2.1 time: 0.154420 Jul 14 16:03:54.471524 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 388/777] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:54 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:55.486052 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:55.486683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:55.494986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.495637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.496569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.497304 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.638467 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:55.645935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-26d181c7-5dd3-4e70-8faa-b2dac79de9f3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1685 microversion: 2.1 time: 0.164160 Jul 14 16:03:55.646543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 390/778] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:55 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:56.666852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:56.668357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:56.675731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e2dc4c9c-98e8-4bc0-8f59-d65511f03ddd req-ed60d60e-4000-4c50-aff0-15b8b9db7c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41756c6f-5714-4b75-b3fb-ee75edcac924", "name": "network-vif-deleted", "tag": "fd63becb-ed28-4d91-8401-801a37b8d3fa"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:56.678193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.678838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.680283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.680973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.691888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e2dc4c9c-98e8-4bc0-8f59-d65511f03ddd req-ed60d60e-4000-4c50-aff0-15b8b9db7c65 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.693108 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e2dc4c9c-98e8-4bc0-8f59-d65511f03ddd req-ed60d60e-4000-4c50-aff0-15b8b9db7c65 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.706229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e2dc4c9c-98e8-4bc0-8f59-d65511f03ddd req-ed60d60e-4000-4c50-aff0-15b8b9db7c65 service nova] Creating event network-vif-deleted:fd63becb-ed28-4d91-8401-801a37b8d3fa for instance 41756c6f-5714-4b75-b3fb-ee75edcac924 on hv-cinder-84986 Jul 14 16:03:56.713873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e2dc4c9c-98e8-4bc0-8f59-d65511f03ddd req-ed60d60e-4000-4c50-aff0-15b8b9db7c65 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047389 Jul 14 16:03:56.714630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 391/779] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:56.750153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:56.759326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9d221210-2892-445f-98b2-15139fde83d3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1617 microversion: 2.1 time: 0.099156 Jul 14 16:03:56.760298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 389/780] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:56 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1617 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:57.777689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.778393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.784881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.785334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.786102 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.786541 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.844823 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.845365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.845891 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'fault' on Instance uuid 41756c6f-5714-4b75-b3fb-ee75edcac924 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:57.891864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:57.899844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1efc2387-314a-40c9-a1f4-dd07235a3563 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 200 len: 1335 microversion: 2.1 time: 0.126959 Jul 14 16:03:57.900473 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 392/781] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:57 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 1335 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:58.920339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.920943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:58.928317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.928777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.929576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.930034 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.943981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 HTTP/1.1 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:03:58.945534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:03:58.947027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '41756c6f-5714-4b75-b3fb-ee75edcac924'} Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:58.947869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:03:58.949093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:03:58.950135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:58.950135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a0796a8-f1b8-43e1-8ece-94518314713c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 404 len: 111 microversion: 2.1 time: 0.030511 Jul 14 16:03:58.950135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 390/782] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:03:58 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:58.956600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb615c72-eb46-4c92-a662-1f309f9153f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '.version_select at 0x7f0dc1bbf280>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.959986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb615c72-eb46-4c92-a662-1f309f9153f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [a93f9d2b-adb5-435f-a44a-f5505f9f97c3] AMQP server on 10.222.0.119:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:03:59.967252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb615c72-eb46-4c92-a662-1f309f9153f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [a93f9d2b-adb5-435f-a44a-f5505f9f97c3] Reconnected to AMQP server on 10.222.0.119:5672 via [amqp] client with port 37792. Jul 14 16:03:59.974056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:00.116757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb615c72-eb46-4c92-a662-1f309f9153f8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269085348" status: 202 len: 0 microversion: 2.1 time: 1.163951 Jul 14 16:04:00.117454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 393/783] 10.222.0.119 () {58 vars in 1225 bytes} [Thu Jul 14 16:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269085348 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:04:01.332533 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8333f0de-43f2-4e93-bcfd-16fc536a7840 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: .version_select at 0x7f0dc1d0c4c0>, body: {"keypair": {"name": "tempest-keypair-1413714979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFNYbpqtPDAqXrhixhKpmfW3QKKieFX63TWLfzutsFNdGkEtWyR/Yw/1bSVGAieMRSSMJrhcXFMMyoq5wWq0AAyDgM8Y9IN6TC/GwP//L06w/wx4M7sz7wIwpCqm4QlzA=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:01.337629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:01.348504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8333f0de-43f2-4e93-bcfd-16fc536a7840 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:01.355766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8333f0de-43f2-4e93-bcfd-16fc536a7840 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:01.556737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8333f0de-43f2-4e93-bcfd-16fc536a7840 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.228168 Jul 14 16:04:01.557377 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 391/784] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:04:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:04:04.533421 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-646834176", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81beb021-9d5c-47cd-b940-d1c5b4031ad6"}], "security_groups": [{"name": "tempest-securitygroup--941894909"}], "key_name": "tempest-keypair-1413714979", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:04.637103 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] validate_networks() for [('81beb021-9d5c-47cd-b940-d1c5b4031ad6', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:04:05.007352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:04:05.007888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:04:05.008395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:04:05.015514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:04:05.015514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:04:05.018299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.018732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.019534 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.019991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.039764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:05.044237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:05.055995 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:04:05.058290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:04:05.166006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:05.166516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:05.173037 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.173493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.174254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.174691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.255784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d72a2294-9057-4848-b0ae-17b05ff3128a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.727581 Jul 14 16:04:05.256314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'services' on Instance uuid 4fd3f295-799c-49ef-a570-bfb044012311 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:04:05.256466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 394/785] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:04:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 14 16:04:05.267453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84e2df48-deaf-4e3e-b658-727491734615 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:05.268397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84e2df48-deaf-4e3e-b658-727491734615 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:05.343428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84e2df48-deaf-4e3e-b658-727491734615 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:05.351871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84e2df48-deaf-4e3e-b658-727491734615 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1245 microversion: 2.1 time: 0.087111 Jul 14 16:04:05.352485 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 395/786] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:05 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:05.571197 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26730bcd-9dc3-4da7-8c5d-5faa91bdbbf3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments/30be4b81-919e-4651-9214-157b077e0545" status: 202 len: 0 microversion: 2.1 time: 0.409652 Jul 14 16:04:05.571789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 392/787] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:04:05 2022] DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments/30be4b81-919e-4651-9214-157b077e0545 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:04:05.582131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:05.583126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:05.591759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.592310 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.601715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.601715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.627736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47fde2fb-1c06-4a73-866f-c685b93e704f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049514 Jul 14 16:04:05.628655 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 396/788] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:05 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:06.369037 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:06.369739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:06.376118 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.376601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.377360 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.377810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.439193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:06.447001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96fb7e50-a795-482f-a093-9bb5869a89b2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1249 microversion: 2.1 time: 0.082658 Jul 14 16:04:06.447577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 393/789] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:06 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:06.639333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:06.640326 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:06.646992 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.647440 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.648239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.648672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.666082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:06.678259 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2d2afdd2-6289-47ab-9f36-500be345080e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Jul 14 16:04:06.678832 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 397/790] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:06 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:07.463415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.464330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.471030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.471478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.472307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.472747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.536181 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:07.546049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f674f86b-fa8d-4330-b37c-d96eb170f61d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1249 microversion: 2.1 time: 0.086499 Jul 14 16:04:07.546614 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 394/791] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:07 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:07.690118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.691032 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.698254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.698698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.699457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.699889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.729339 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9fbf0729-3146-4709-ae65-f351c99ac92f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Jul 14 16:04:07.730084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 398/792] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:07 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:04:08.562972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:08.563551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:08.570078 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.570527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.571294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.571874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.634088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:08.641616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-813ce442-51f4-4aaa-a62d-0d7d50ddc6f6 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1249 microversion: 2.1 time: 0.082613 Jul 14 16:04:08.655566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 395/793] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:08 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:08.742914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:08.744230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:08.751499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.751954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.752750 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.753194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.783592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ceab2d8-eda0-4a08-a961-98b79f5381c6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Jul 14 16:04:08.785202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 399/794] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:08 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:09.671237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:09.671857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:09.680197 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.681690 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.682724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.683199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.750466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:09.758303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a14bb8f0-93f9-4a02-892f-698bec7923de tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1241 microversion: 2.1 time: 0.091736 Jul 14 16:04:09.759487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 396/795] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:09 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:09.795495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:09.796354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:09.803330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.803782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.804574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.805010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.834148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fe232205-e9ac-4333-8579-14f451eaf981 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 Jul 14 16:04:09.834698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 400/796] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:09 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:10.776375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:10.776932 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:10.783414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.783877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.784713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.785160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.847243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:10.849650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:10.851910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:10.856984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.857429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.858356 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.858795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.862781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1566004f-8dd2-4d99-83b9-cef059668d49 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1305 microversion: 2.1 time: 0.091036 Jul 14 16:04:10.872777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 397/797] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:10 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:10.897792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d3e3e7d8-2b50-4971-a680-22057ce9fd90 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054731 Jul 14 16:04:10.898423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 401/798] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:10 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:04:10.981284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:10.981783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:10.987913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.988395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.989165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.989608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.013912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:11.041106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:11.355013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e815866-27bc-4e3f-a7eb-bba8d35fd53a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 204 len: 0 microversion: 2.1 time: 0.378088 Jul 14 16:04:11.357302 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 398/799] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:04:10 2022] DELETE /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:04:11.363848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:11.364447 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:11.370809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.371262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.372034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.372504 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.503909 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.513394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-83984bba-48e2-4722-931d-f0cb47104f8e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.153506 Jul 14 16:04:11.513985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 402/800] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:11 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:11.881527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:11.882224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:11.885099 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:11.890396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.890840 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.891606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.892045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.957068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.964872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6df03114-ee87-4714-b42b-828a50256579 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1315 microversion: 2.1 time: 0.087677 Jul 14 16:04:11.965436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 399/801] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:11 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:12.532071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:12.532855 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:12.539706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.540803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.541877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.542263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.697498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:12.705856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3938ac32-4d0f-4b72-ab5c-2715ef4992d9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.178538 Jul 14 16:04:12.706442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 403/802] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:12 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:12.982022 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:12.982692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:12.989536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.989988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.991691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.991691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.141948 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:13.150227 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-577d8c55-fedc-4d55-bf65-d1404381eac5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.172173 Jul 14 16:04:13.150900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 400/803] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:12 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:13.724433 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:13.725054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:13.732665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.733124 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.733906 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.734414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.875235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:13.882864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d45e0479-d750-458a-bde5-038c57ebf4f6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.162338 Jul 14 16:04:13.883427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 404/804] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:13 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:14.169476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:14.170212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:14.176794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.177242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.178005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.178435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.312822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:14.320087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-61990f41-241c-4867-99c9-4ee00ffeefe2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.155100 Jul 14 16:04:14.320659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 401/805] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:14 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:14.899789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:14.900438 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:14.907130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.907574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.908357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.908793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.031631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:15.038972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.047648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-789d0ca5-56fa-4a10-817e-df9e2e54fad8 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.151842 Jul 14 16:04:15.048243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 405/806] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:14 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:15.337065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:15.338299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:15.345140 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.345595 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.346357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.346791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.475972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.483797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e45fa8d7-b85e-4e4f-be82-fd3215e9ab8a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.151093 Jul 14 16:04:15.484459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 402/807] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:15 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:16.069305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:16.069904 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:16.073287 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:16.081272 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.081272 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.081272 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.081272 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.211211 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:16.219626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-810e83fd-6796-4eb0-9821-22c83acb4f39 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.154266 Jul 14 16:04:16.220207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 406/808] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:16 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:16.500888 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:16.501435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:16.508069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.508580 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.509977 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.510414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.644378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:16.652008 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d2937bc3-3735-45a9-b027-a070429a0de3 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.155020 Jul 14 16:04:16.652622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 403/809] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:16 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:17.237237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:17.237849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:17.245008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.245463 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.246230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.246678 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.388633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.396299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8d794d5c-8698-48ff-b1dd-00f4bc8a5791 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.162876 Jul 14 16:04:17.396870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 407/810] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:17 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:17.670207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:17.670817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:17.677312 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.677782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.678540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.678976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.809134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.816679 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d191676-eddc-484c-8f02-0b8f73b0bf35 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.151798 Jul 14 16:04:17.817242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 404/811] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:17 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:18.414608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:18.415670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:18.422504 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.423063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.423837 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.424308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.567070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.567557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06c14365-f165-4f08-b22f-3286c10fc0c4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.156841 Jul 14 16:04:18.568150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 408/812] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:18 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:18.833779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:18.834395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:18.841210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.841658 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.842447 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.842884 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.973979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.981609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3d18d976-9f55-437e-b6ef-94479bcdf819 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.151676 Jul 14 16:04:18.982175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 405/813] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:18 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:19.587583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:19.627964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:19.627964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.627964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.627964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.629062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.758162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:19.758162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b26add5f-8a63-4174-9d72-19ae8e34a5d4 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.157508 Jul 14 16:04:19.758162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 409/814] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:19 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:19.998868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:19.999471 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:20.005908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.006350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.007102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.007530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.133508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.141021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-16e10047-f01e-42a8-a2f5-30b7b123a3a0 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.146750 Jul 14 16:04:20.141592 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 406/815] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:19 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:20.766573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:20.767186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:20.773853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.774311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.775078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.775526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.908360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.915949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f7a4598-bf5b-4797-8783-aa420a38d81c tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.153328 Jul 14 16:04:20.917393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 410/816] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:20 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:21.158548 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:21.159159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:21.165687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.166748 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.167711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.168178 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.307166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:21.314558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-69e196ee-b5b4-45b4-8852-4d96087cee31 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.159839 Jul 14 16:04:21.315206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 407/817] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:21 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:21.934378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:21.935828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:21.943053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.943437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.944260 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.944698 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.090298 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.098255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a0944dc5-2c27-4661-8b38-ccb7183e9935 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.169008 Jul 14 16:04:22.098825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 411/818] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:21 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:22.128337 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-55531c24-484c-4d96-bd3d-aa6bdd04c879 req-37257aac-8f01-4170-9bb4-a3712ba62191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d297bd53-1291-4d7e-ac92-6bb50b22a623", "tag": "fbb35928-21d0-4314-9692-0ae8ddb46d67"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:22.141068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-55531c24-484c-4d96-bd3d-aa6bdd04c879 req-37257aac-8f01-4170-9bb4-a3712ba62191 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:22.145839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-55531c24-484c-4d96-bd3d-aa6bdd04c879 req-37257aac-8f01-4170-9bb4-a3712ba62191 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.162334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-55531c24-484c-4d96-bd3d-aa6bdd04c879 req-37257aac-8f01-4170-9bb4-a3712ba62191 service nova] Creating event network-changed:fbb35928-21d0-4314-9692-0ae8ddb46d67 for instance d297bd53-1291-4d7e-ac92-6bb50b22a623 on hv-cinder-84986 Jul 14 16:04:22.169518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-55531c24-484c-4d96-bd3d-aa6bdd04c879 req-37257aac-8f01-4170-9bb4-a3712ba62191 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046151 Jul 14 16:04:22.170293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 408/819] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:22.333642 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:22.335222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:22.344055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:22.347474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.347474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:22.347474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.504370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.512667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f92e75b-98b4-41be-96cf-01df292abd7b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.184030 Jul 14 16:04:22.513637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 412/820] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:22 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:23.116797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:23.117639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:23.126334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.126868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.127714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.128254 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.284086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.288784 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6662a2b-b448-419c-8163-267db2cf1c6b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1691 microversion: 2.1 time: 0.176540 Jul 14 16:04:23.289543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 409/821] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:23 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:23.532427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:23.533169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:23.539833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.540400 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.542581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.543159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.691782 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.708057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fcdaf8ff-548e-4e10-89e2-882c4111c120 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.183116 Jul 14 16:04:23.708832 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 413/822] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:23 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:24.306799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:24.309005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:24.316669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.317305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.318275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.318900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.319520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-1cf97473-7b8f-442d-bf81-ea2ee40311e2 req-fcb4e549-36f1-4faf-95a4-4de53a131934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd3f295-799c-49ef-a570-bfb044012311", "name": "network-vif-deleted", "tag": "30437136-f4f7-42de-8372-31535281820b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:24.327898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1cf97473-7b8f-442d-bf81-ea2ee40311e2 req-fcb4e549-36f1-4faf-95a4-4de53a131934 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.328496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1cf97473-7b8f-442d-bf81-ea2ee40311e2 req-fcb4e549-36f1-4faf-95a4-4de53a131934 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.332984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:24.340688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-1cf97473-7b8f-442d-bf81-ea2ee40311e2 req-fcb4e549-36f1-4faf-95a4-4de53a131934 service nova] Creating event network-vif-deleted:30437136-f4f7-42de-8372-31535281820b for instance 4fd3f295-799c-49ef-a570-bfb044012311 on hv-cinder-84986 Jul 14 16:04:24.346062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-1cf97473-7b8f-442d-bf81-ea2ee40311e2 req-fcb4e549-36f1-4faf-95a4-4de53a131934 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030168 Jul 14 16:04:24.347203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 414/823] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:04:24.394601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:24.397188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c852a279-dc60-49ac-b676-69697064db15 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1624 microversion: 2.1 time: 0.094709 Jul 14 16:04:24.397851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 410/824] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:24 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1624 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:24.727183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:24.727890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:24.735151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.735587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.736416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.736852 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.877834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:24.886039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61f9f088-96a2-4c23-bba3-d3eb3e571d1a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.163775 Jul 14 16:04:24.886661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 415/825] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:24 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:25.415063 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:25.415792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:25.422559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.423015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.423786 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.424258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.496424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:25.503976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2bc33b8-6057-4df8-a08d-34f19c97fade tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1624 microversion: 2.1 time: 0.092829 Jul 14 16:04:25.504647 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 411/826] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:25 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:25.902941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:25.903585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:25.910104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.910547 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.911298 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.911744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.042760 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.050259 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-37feedef-9fda-4a5e-911a-c07d7c9b3836 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.151514 Jul 14 16:04:26.050847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 416/827] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:25 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:26.522652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:26.523257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:26.532496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.532944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.533706 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.534135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.595475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.603046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78022861-1eb4-4dc2-ada6-f89db12e78ab tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1624 microversion: 2.1 time: 0.084851 Jul 14 16:04:26.603626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 412/828] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:26 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1624 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:27.066806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:27.067450 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:27.074041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.074483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.075258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.075691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.238174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:27.246122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cad014b7-e26d-49a9-9edf-f3907a055b17 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.182960 Jul 14 16:04:27.247116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 417/829] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:27 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:27.622038 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:27.622670 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:27.629490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.629941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.630714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.631160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.661735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.662184 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.662630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'fault' on Instance uuid 4fd3f295-799c-49ef-a570-bfb044012311 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:04:27.703766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:27.711655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4fd1965f-cc5b-4b59-97fa-a013b5d44f8a tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 200 len: 1338 microversion: 2.1 time: 0.094025 Jul 14 16:04:27.712253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 413/830] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:27 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:28.263402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:28.263958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:28.270543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.271041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.271861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.272339 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.415025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:28.424212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21ab7910-29da-49ed-806e-d8b31ddb0c48 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.165166 Jul 14 16:04:28.424798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 418/831] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:28 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:28.734025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:28.734657 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 4fd3f295-799c-49ef-a570-bfb044012311] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:28.741126 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.741569 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.742353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.742792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.756711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] HTTP exception thrown: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Request method failure captured: Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 HTTP/1.1 Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvIzNluMjDp4d3DT5QnvYlw7pRmop_TCGkbaYTQiG5SxYVEGSYRm0dhjXXOMfnm61qx9mJxERTKeTRsuliirCltEJ6xQiwu_JdJxnN2xoKgc1SV0WzqvRAmVBQR9GNIOwARxvOu71BmMHSM1575bPlVIAEYo0-7gIauEqjsC3ZS_o Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:04:28.758380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_2604fe90997b48439ed17360fa15f24a", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}] Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: fe6f58bedd87454bad46b0c48697eec9 Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. Jul 14 16:04:28.763100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '4fd3f295-799c-49ef-a570-bfb044012311'} Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:28.764148 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. Jul 14 16:04:28.765688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:28.767059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Returning 404 to user: Instance 4fd3f295-799c-49ef-a570-bfb044012311 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:28.767059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e17267af-6f85-4403-bf34-998840f05820 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311" status: 404 len: 111 microversion: 2.1 time: 0.030467 Jul 14 16:04:28.767059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 414/832] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:28 2022] GET /compute/v2.1/servers/4fd3f295-799c-49ef-a570-bfb044012311 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:28.769529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-33970031-e5a0-4cc0-b7dc-1e788bed5566 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '.version_select at 0x7f0dc1bbf820>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:28.908952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-33970031-e5a0-4cc0-b7dc-1e788bed5566 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892830047" status: 202 len: 0 microversion: 2.1 time: 0.143268 Jul 14 16:04:28.909804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 419/833] 10.222.0.119 () {58 vars in 1222 bytes} [Thu Jul 14 16:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892830047 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:04:29.441979 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:29.442459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:29.449342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.449795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.450577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.451179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.469768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:29.613429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:29.621620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-64f382a0-c944-4d42-9299-a689fd66eabc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.184287 Jul 14 16:04:29.622194 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 415/834] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:29 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:29.827346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-d492aed8-7deb-4daa-9f06-a017ac891260 req-f1a375d2-2c35-4ba3-990e-c1fae7ebef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d297bd53-1291-4d7e-ac92-6bb50b22a623", "name": "network-vif-plugged", "status": "completed", "tag": "fbb35928-21d0-4314-9692-0ae8ddb46d67"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:29.836892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d492aed8-7deb-4daa-9f06-a017ac891260 req-f1a375d2-2c35-4ba3-990e-c1fae7ebef71 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.837479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d492aed8-7deb-4daa-9f06-a017ac891260 req-f1a375d2-2c35-4ba3-990e-c1fae7ebef71 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.849672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-d492aed8-7deb-4daa-9f06-a017ac891260 req-f1a375d2-2c35-4ba3-990e-c1fae7ebef71 service nova] Creating event network-vif-plugged:fbb35928-21d0-4314-9692-0ae8ddb46d67 for instance d297bd53-1291-4d7e-ac92-6bb50b22a623 on hv-cinder-84986 Jul 14 16:04:29.855866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-d492aed8-7deb-4daa-9f06-a017ac891260 req-f1a375d2-2c35-4ba3-990e-c1fae7ebef71 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Jul 14 16:04:29.856507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 420/835] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:30.639955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:30.640606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:30.648438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.648908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.649864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.650328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.782011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:30.789478 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcc88556-4a80-4a3f-b9f1-c824ac6b52ea tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.154948 Jul 14 16:04:30.790074 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 416/836] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:30 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:31.807691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:31.808654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:31.865008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.865008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.865008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.865008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.954711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:31.962173 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62bc4099-c58f-49c5-96b7-2287e8205ce7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1370 microversion: 2.1 time: 0.159518 Jul 14 16:04:31.962967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 421/837] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:31 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:32.520804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:32.521334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:32.527773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.528319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.529092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.529532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.557009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:32.982001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:32.982654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:32.989972 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.990421 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.991189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.991619 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.100482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d5393141-b007-4746-a97f-329feda94bb9 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 204 len: 0 microversion: 2.1 time: 0.583094 Jul 14 16:04:33.101085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 417/838] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:04:32 2022] DELETE /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:33.112196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:33.112905 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:33.122404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.127021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.127021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.127021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.144034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.152132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86afda47-d3db-4fe5-9477-14a4c8faa2cf tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1561 microversion: 2.1 time: 0.176764 Jul 14 16:04:33.153224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 422/839] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:32 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:33.169300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:33.170043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:33.177426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.177885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.178662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.179101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.295224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f4c7b8ff-c2a3-4f69-b39f-a0ce84c86cb9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130533 Jul 14 16:04:33.296975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 423/840] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 16:04:33 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:04:33.319698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.328014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f9da2f50-9414-4611-ba9c-ac732759e1c3 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1512 microversion: 2.1 time: 0.222456 Jul 14 16:04:33.328747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 418/841] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:33 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:34.346318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:34.347577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:34.357827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.358304 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.359087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.359769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.475104 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-00007840-ef2f-4c96-b9b3-ae6e13c8d1a1 req-79761598-a314-4544-9804-b0c9cbfdd695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d297bd53-1291-4d7e-ac92-6bb50b22a623", "tag": "fbb35928-21d0-4314-9692-0ae8ddb46d67"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:34.504687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-00007840-ef2f-4c96-b9b3-ae6e13c8d1a1 req-79761598-a314-4544-9804-b0c9cbfdd695 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.505465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-00007840-ef2f-4c96-b9b3-ae6e13c8d1a1 req-79761598-a314-4544-9804-b0c9cbfdd695 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.543166 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-00007840-ef2f-4c96-b9b3-ae6e13c8d1a1 req-79761598-a314-4544-9804-b0c9cbfdd695 service nova] Creating event network-changed:fbb35928-21d0-4314-9692-0ae8ddb46d67 for instance d297bd53-1291-4d7e-ac92-6bb50b22a623 on hv-cinder-84986 Jul 14 16:04:34.552389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-00007840-ef2f-4c96-b9b3-ae6e13c8d1a1 req-79761598-a314-4544-9804-b0c9cbfdd695 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081464 Jul 14 16:04:34.553006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 419/842] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:34.566593 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:34.573324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0cf75739-d170-4052-87fe-37b7ef2f5de6 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1512 microversion: 2.1 time: 0.231131 Jul 14 16:04:34.574646 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 424/843] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:34 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:35.490996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-30faed58-b4ce-4c2e-9bad-b8914c004f3f req-bfca1692-6755-4e64-aab2-1443779f3fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06201b79-aa1b-474d-8a40-6ef60e0498fd", "name": "network-vif-deleted", "tag": "3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:35.497156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:35.506423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-30faed58-b4ce-4c2e-9bad-b8914c004f3f req-bfca1692-6755-4e64-aab2-1443779f3fcb service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:35.512736 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-30faed58-b4ce-4c2e-9bad-b8914c004f3f req-bfca1692-6755-4e64-aab2-1443779f3fcb service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:35.531051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-30faed58-b4ce-4c2e-9bad-b8914c004f3f req-bfca1692-6755-4e64-aab2-1443779f3fcb service nova] Creating event network-vif-deleted:3ff99ba1-0fe0-4324-9c5c-209c38e8f9ad for instance 06201b79-aa1b-474d-8a40-6ef60e0498fd on hv-cinder-84986 Jul 14 16:04:35.537847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-30faed58-b4ce-4c2e-9bad-b8914c004f3f req-bfca1692-6755-4e64-aab2-1443779f3fcb service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063770 Jul 14 16:04:35.540320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 420/844] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:35.591808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:35.593310 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:35.604418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:35.605031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:35.605738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:35.606738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:35.607376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:35.703059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:35.713713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1903632e-fec8-4628-ae97-90a09c564552 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 200 len: 1470 microversion: 2.1 time: 0.126602 Jul 14 16:04:35.716440 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 425/845] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:35 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 1470 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:36.734058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:36.735519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 06201b79-aa1b-474d-8a40-6ef60e0498fd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:36.743661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.744347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.745234 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.746746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.763674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] HTTP exception thrown: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Request method failure captured: Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd HTTP/1.1 Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvIzNluMjDp4d3DT5QnvYlw7pRmop_TCGkbaYTQiG5SxYVEGSYRm0dhjXXOMfnm61qx9mJxERTKeTRsuliirCltEJ6xQiwu_JdJxnN2xoKgc1SV0WzqvRAmVBQR9GNIOwARxvOu71BmMHSM1575bPlVIAEYo0-7gIauEqjsC3ZS_o Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:04:36.765797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_2604fe90997b48439ed17360fa15f24a", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}] Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: fe6f58bedd87454bad46b0c48697eec9 Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. Jul 14 16:04:36.767097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '06201b79-aa1b-474d-8a40-6ef60e0498fd'} Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:36.767817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. Jul 14 16:04:36.769451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:04:36.771525 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Returning 404 to user: Instance 06201b79-aa1b-474d-8a40-6ef60e0498fd could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:36.772423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-983db10c-a9e4-40d1-90ca-209ba5dd1251 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd" status: 404 len: 111 microversion: 2.1 time: 0.043785 Jul 14 16:04:36.773032 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 421/846] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:36 2022] GET /compute/v2.1/servers/06201b79-aa1b-474d-8a40-6ef60e0498fd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:36.781722 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:36.789065 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:36.789954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.790641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.791427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.791860 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.826606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:37.195144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-553ba7e1-af3d-4cc1-8f55-9c7853926b72 tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 204 len: 0 microversion: 2.1 time: 0.417263 Jul 14 16:04:37.195850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 426/847] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:04:36 2022] DELETE /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:37.204502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:37.208819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:37.211605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.212055 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.212852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.213303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.454216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:37.465868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ef1cd1e-3faf-40e3-aa0a-9c8da338b01b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.264370 Jul 14 16:04:37.469045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 422/848] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:37 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:38.484880 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:38.485588 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:38.492457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.493212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.494587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.495075 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.721896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-5a1afe31-8b18-4a2e-8b67-141ced958b3b req-bb058ede-f502-4e9f-bcbc-0dd5c11504b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9596a1-f8ec-4682-a980-392e550ebc33", "name": "network-vif-deleted", "tag": "a289ebfe-7229-4303-8c8b-17ea1de7a70e"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:38.733926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5a1afe31-8b18-4a2e-8b67-141ced958b3b req-bb058ede-f502-4e9f-bcbc-0dd5c11504b2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.734681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5a1afe31-8b18-4a2e-8b67-141ced958b3b req-bb058ede-f502-4e9f-bcbc-0dd5c11504b2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.753472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-5a1afe31-8b18-4a2e-8b67-141ced958b3b req-bb058ede-f502-4e9f-bcbc-0dd5c11504b2 service nova] Creating event network-vif-deleted:a289ebfe-7229-4303-8c8b-17ea1de7a70e for instance 5f9596a1-f8ec-4682-a980-392e550ebc33 on hv-cinder-84986 Jul 14 16:04:38.758503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-5a1afe31-8b18-4a2e-8b67-141ced958b3b req-bb058ede-f502-4e9f-bcbc-0dd5c11504b2 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044153 Jul 14 16:04:38.762882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 423/849] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:38.790511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:38.827098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec218a20-db31-4d92-9a3b-604fd7f4470f tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1526 microversion: 2.1 time: 0.347476 Jul 14 16:04:38.828409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 427/850] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:38 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1526 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:39.845623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:39.846316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:39.852775 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.853226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.853999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.854432 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.886772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.888532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.888532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lazy-loading 'fault' on Instance uuid 5f9596a1-f8ec-4682-a980-392e550ebc33 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:04:39.942327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f58bedd87454bad46b0c48697eec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2604fe90997b48439ed17360fa15f24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:39.953846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-211d36e5-fbc4-43e7-84da-56037ab9c57e tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 200 len: 1316 microversion: 2.1 time: 0.112831 Jul 14 16:04:39.954913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 424/851] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:39 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 1316 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:40.975579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:40.981354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] [instance: 5f9596a1-f8ec-4682-a980-392e550ebc33] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:40.988254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.988706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:40.989483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.993962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.015367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] HTTP exception thrown: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Request method failure captured: Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 HTTP/1.1 Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvIzNluMjDp4d3DT5QnvYlw7pRmop_TCGkbaYTQiG5SxYVEGSYRm0dhjXXOMfnm61qx9mJxERTKeTRsuliirCltEJ6xQiwu_JdJxnN2xoKgc1SV0WzqvRAmVBQR9GNIOwARxvOu71BmMHSM1575bPlVIAEYo0-7gIauEqjsC3ZS_o Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:04:41.017389 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/2604fe90997b48439ed17360fa15f24a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_2604fe90997b48439ed17360fa15f24a", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/2604fe90997b48439ed17360fa15f24a"}]}] Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 2604fe90997b48439ed17360fa15f24a Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800704686 Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: fe6f58bedd87454bad46b0c48697eec9 Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800704686-project Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. Jul 14 16:04:41.023531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '5f9596a1-f8ec-4682-a980-392e550ebc33'} Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:41.024749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. Jul 14 16:04:41.026686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:41.029442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] Returning 404 to user: Instance 5f9596a1-f8ec-4682-a980-392e550ebc33 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:41.029442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ccd2c62e-f879-4eac-9911-ba32ed9e636b tempest-ServerRescueNegativeTestJSON-1800704686 tempest-ServerRescueNegativeTestJSON-1800704686-project] 10.222.0.119 "GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33" status: 404 len: 111 microversion: 2.1 time: 0.051370 Jul 14 16:04:41.029442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 428/852] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:40 2022] GET /compute/v2.1/servers/5f9596a1-f8ec-4682-a980-392e550ebc33 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:47.428620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-030fb6da-1d2d-417f-98fe-2de175ae7d20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Action: 'create', calling method: .version_select at 0x7f0dc1eff700>, body: {"keypair": {"name": "tempest-TestShelveInstance-905132168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/wttrQWyc6CVWnbNNnKK1ZvPFvTJV9Dn5Eyb4jA8dihJ+/g9O/3H46hzypm7VVc9e/y4ohCxxB0eKYVrJgYIaaYeyTcagYr0eZY0lWkTuAwQqo7Mx7IwOASnmCrPwH8w=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:47.448694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-030fb6da-1d2d-417f-98fe-2de175ae7d20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Getting quotas for project 7469c47f14be40df88cc57050d28e8ba. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:47.453225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-030fb6da-1d2d-417f-98fe-2de175ae7d20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Getting quotas for user c78eff78e8564d0ba386bcd02137aa35 and project 7469c47f14be40df88cc57050d28e8ba. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:47.585898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-030fb6da-1d2d-417f-98fe-2de175ae7d20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.434367 Jul 14 16:04:47.588918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 425/853] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:04:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:50.986393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:51.003721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:51.150483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1504450252"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:51.151058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:51.161082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.161529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.162353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.162786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.380902 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.network.security_group_api [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Removing security group e620addb-261f-4a04-8075-87e59777a29f from port ceb2f3fe-a0a1-43df-b885-d12cb859d85a Jul 14 16:04:52.444090 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-333765b0-62df-4bcf-b66a-f17b5f5d8f69 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action" status: 202 len: 0 microversion: 2.1 time: 1.517416 Jul 14 16:04:52.445818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 429/854] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:04:50 2022] POST /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/action => generated 0 bytes in 1520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:04:52.491258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:52.500139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-bfd369ae-76d4-4ba2-9e23-84a0b6406e1c req-76c6a13f-7dd7-4ea9-b252-8dd610cd8e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:52.532626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-bfd369ae-76d4-4ba2-9e23-84a0b6406e1c req-76c6a13f-7dd7-4ea9-b252-8dd610cd8e50 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:52.536751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-bfd369ae-76d4-4ba2-9e23-84a0b6406e1c req-76c6a13f-7dd7-4ea9-b252-8dd610cd8e50 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:52.583769 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-bfd369ae-76d4-4ba2-9e23-84a0b6406e1c req-76c6a13f-7dd7-4ea9-b252-8dd610cd8e50 service nova] Creating event network-changed:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:04:52.595408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-bfd369ae-76d4-4ba2-9e23-84a0b6406e1c req-76c6a13f-7dd7-4ea9-b252-8dd610cd8e50 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105653 Jul 14 16:04:52.596551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 426/855] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:54.872975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:54.872975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:54.879040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-4f601231-34f0-4c27-a717-43bcc94604d7 req-4731c23d-fc56-42b8-b84d-61dae739453d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:54.896384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.896831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.897830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.898290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.902361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4f601231-34f0-4c27-a717-43bcc94604d7 req-4731c23d-fc56-42b8-b84d-61dae739453d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.902820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4f601231-34f0-4c27-a717-43bcc94604d7 req-4731c23d-fc56-42b8-b84d-61dae739453d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.916562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4f601231-34f0-4c27-a717-43bcc94604d7 req-4731c23d-fc56-42b8-b84d-61dae739453d service nova] Creating event network-changed:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:04:54.927503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-4f601231-34f0-4c27-a717-43bcc94604d7 req-4731c23d-fc56-42b8-b84d-61dae739453d service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052925 Jul 14 16:04:54.932190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 427/856] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:55.026799 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lazy-loading 'services' on Instance uuid 561e084a-06c0-478e-804b-15be8ae9c6dd {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:04:55.305810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b115cee-023e-4c6d-993e-47522f1d4f6b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments/d654a753-dbd2-48f6-8584-97ce73dc763a" status: 202 len: 0 microversion: 2.1 time: 0.436960 Jul 14 16:04:55.311274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 430/857] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:04:54 2022] DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments/d654a753-dbd2-48f6-8584-97ce73dc763a => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:04:55.316980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:55.373412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:55.373412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:55.373412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:55.373412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:55.374062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:55.408933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3354e7d2-b296-4346-b2b3-a7b9c4f0d6ff tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096982 Jul 14 16:04:55.409620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 428/858] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:55 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:56.422704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:56.423893 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:56.431156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.431608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.445193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.445193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.493849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6586246b-2df3-4ee2-b889-fa70ca0a3f91 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075645 Jul 14 16:04:56.495369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 431/859] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:56 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:57.423261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-138d6960-699c-496d-9aca-e5a24f604843 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: .version_select at 0x7f0dc1d3adc0>, body: {"keypair": {"name": "tempest-keypair-1037907091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQI9TEDzAK2znJMw35XxUnLMS+vvckENDvpAxFRqrPNWjiMCtw+ZXwFBylQdBkMbiqu9S5XL2KQ5P9EKeDVQgF07U4NmNCfvAwbTOtQUiPgq83liwzlpztdPN5pC/PuWA=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:57.439113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-138d6960-699c-496d-9aca-e5a24f604843 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for project f50528750c0e4504aaafba1ebae3f707. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:57.443886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-138d6960-699c-496d-9aca-e5a24f604843 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for user 8874a26203f0408f8d8c9f26b2818b59 and project f50528750c0e4504aaafba1ebae3f707. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:57.507198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.510886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.515871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.516919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.518367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.519194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.556411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e31d414e-63e7-46c3-a53e-57f3118ba53c tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053748 Jul 14 16:04:57.557015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 432/860] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:57 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:04:57.568334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.568969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.575741 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.576209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.577065 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.596257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.615655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-138d6960-699c-496d-9aca-e5a24f604843 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.256596 Jul 14 16:04:57.616446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 429/861] 10.222.0.119 () {62 vars in 1204 bytes} [Thu Jul 14 16:04:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 16:04:57.622435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.623618 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.630652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.633212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.633212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.633212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.663186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] HTTP exception thrown: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd is not attached to volume d654a753-dbd2-48f6-8584-97ce73dc763a Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Request method failure captured: Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments/d654a753-dbd2-48f6-8584-97ce73dc763a HTTP/1.1 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D1PYpXozEgC0ioLH0qIqt4so9RUFZ-D4M4nezVOBuiS4Cs2Wcv0W7CZEDBTRIHuv-eDFNUSkZjc_SdXyo9Vquxdgzna_MBBhSA-VpRmjboEfxIlQseC54162EPB9wfQHXe0OjTpDX5tD8lJNpaEBz6y5jmpgxtJJ0AKJaH9PS6Cdr8 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: cffc3cae7b014c62b9b58207cb7ef3aa Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:04:57.665788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cffc3cae7b014c62b9b58207cb7ef3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cffc3cae7b014c62b9b58207cb7ef3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cffc3cae7b014c62b9b58207cb7ef3aa", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cffc3cae7b014c62b9b58207cb7ef3aa"}]}] Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: cffc3cae7b014c62b9b58207cb7ef3aa Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-TestMinimumBasicScenario-1405427067-project Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: aad6767795b0402cb72f249b4c3a8039 Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestMinimumBasicScenario-1405427067-project Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:04:57.667419 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd is not attached to volume d654a753-dbd2-48f6-8584-97ce73dc763a Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'server_id': '561e084a-06c0-478e-804b-15be8ae9c6dd', 'id': 'd654a753-dbd2-48f6-8584-97ce73dc763a'} Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d654a753-dbd2-48f6-8584-97ce73dc763a. Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:57.670513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd is not attached to volume d654a753-dbd2-48f6-8584-97ce73dc763a Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd is not attached to volume d654a753-dbd2-48f6-8584-97ce73dc763a Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:04:57.673246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Returning 404 to user: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd is not attached to volume d654a753-dbd2-48f6-8584-97ce73dc763a {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:57.675478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a82381a3-f332-4a09-ae6a-d78e7f48af7e tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments/d654a753-dbd2-48f6-8584-97ce73dc763a" status: 404 len: 154 microversion: 2.1 time: 0.103132 Jul 14 16:04:57.675812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-95ed9063-547a-4a11-8382-a3611aac0ccc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049837 Jul 14 16:04:57.676294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 433/862] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:04:57 2022] DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd/os-volume_attachments/d654a753-dbd2-48f6-8584-97ce73dc763a => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:57.680704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 430/863] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:04:57 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:04:57.756976 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.760292 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.767408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.767857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.768780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.769327 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.797484 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:58.144223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f6872ea4-7ea5-41a0-ab3e-df45665fa589 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 204 len: 0 microversion: 2.1 time: 0.392700 Jul 14 16:04:58.144818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 434/864] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:04:57 2022] DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:58.153306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:58.154133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:58.164812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.165272 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.166062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.166499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.344928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.354588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-22ff5bd5-d8ba-48fe-9b4e-6ede9067c18f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1678 microversion: 2.1 time: 0.205423 Jul 14 16:04:58.355162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 431/865] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:58 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:58.973579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:58.973579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:58.979255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.979742 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.980669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.981141 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.007576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:59.359459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e512dca4-01e4-4c85-85d2-3cb907f45684 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 204 len: 0 microversion: 2.1 time: 0.391356 Jul 14 16:04:59.360213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 435/866] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:04:58 2022] DELETE /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:59.373400 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:59.375180 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:59.375710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:59.376480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:59.390808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.393127 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.393127 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.393127 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.398401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.399698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.412993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.413915 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.763827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.769262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.784857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-78b88613-627c-4901-bb69-c964d1469824 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1678 microversion: 2.1 time: 0.412838 Jul 14 16:04:59.784857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 436/867] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:59 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:59.801026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81564183-e32f-4219-b7a4-2dbefb2da9ba tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1557 microversion: 2.1 time: 0.435768 Jul 14 16:04:59.801615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 432/868] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:04:59 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1557 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:00.783018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1492074124", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b3927a5-e351-442d-a0b8-241c848eece6"}], "security_groups": [{"name": "tempest-securitygroup--1676951344"}], "key_name": "tempest-keypair-1037907091", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:00.799007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:00.799780 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:00.806951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.807406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.809335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.809808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.940565 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] validate_networks() for [('3b3927a5-e351-442d-a0b8-241c848eece6', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:01.052261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.061205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e5246333-8cda-49a0-934f-98a748ac48ef tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1678 microversion: 2.1 time: 0.266031 Jul 14 16:05:01.064580 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 433/869] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:00 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:01.066499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:01.067178 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:01.073531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.074093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.075202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.075651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.276369 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.284183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d4ee2feb-53a2-4dad-b0ba-4846a2bfe95b tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1557 microversion: 2.1 time: 0.221353 Jul 14 16:05:01.284704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 434/870] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:01 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:01.431563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:01.432134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:01.432714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:01.433151 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:01.433677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:01.444372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.444830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.445629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.446066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.466084 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for project f50528750c0e4504aaafba1ebae3f707. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:01.470691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for user 8874a26203f0408f8d8c9f26b2818b59 and project f50528750c0e4504aaafba1ebae3f707. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:01.482978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:01.485426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:01.607907 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b5f96c5-23f1-4472-b79c-594d531c82ac tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.829068 Jul 14 16:05:01.608579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 437/871] 10.222.0.119 () {62 vars in 1192 bytes} [Thu Jul 14 16:05:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 16:05:01.618630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:01.619273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:01.681535 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.689030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.690586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.691683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9786e3bd-a873-482a-a293-ac95c94e5288 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1286 microversion: 2.20 time: 0.077053 Jul 14 16:05:01.692272 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 435/872] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:01 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:02.083586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.084287 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.093002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.093457 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.094255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.094697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.245057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.253329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4aecc752-8ea0-4514-9fea-9f91a816c99a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1678 microversion: 2.1 time: 0.173700 Jul 14 16:05:02.253990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 438/873] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:02.302113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.302640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.309558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.310007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.310770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.311206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.462995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.472751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c1de88f-c247-4b7b-bfb4-0015e36cb33a tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1557 microversion: 2.1 time: 0.174610 Jul 14 16:05:02.473624 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 436/874] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:02.709758 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.710370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.765233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.773595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.775300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.776532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d03287b1-d8f3-444e-a4be-f059a6e10cc8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1286 microversion: 2.20 time: 0.070671 Jul 14 16:05:02.777096 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 439/875] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:02.948999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-b8fca326-265c-4595-a798-d9c7aad342b7 req-3dad04d2-8355-4180-9273-5b416ccab2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561e084a-06c0-478e-804b-15be8ae9c6dd", "name": "network-vif-deleted", "tag": "ceb2f3fe-a0a1-43df-b885-d12cb859d85a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:02.976082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-b8fca326-265c-4595-a798-d9c7aad342b7 req-3dad04d2-8355-4180-9273-5b416ccab2c3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.976452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-b8fca326-265c-4595-a798-d9c7aad342b7 req-3dad04d2-8355-4180-9273-5b416ccab2c3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.000173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-b8fca326-265c-4595-a798-d9c7aad342b7 req-3dad04d2-8355-4180-9273-5b416ccab2c3 service nova] Creating event network-vif-deleted:ceb2f3fe-a0a1-43df-b885-d12cb859d85a for instance 561e084a-06c0-478e-804b-15be8ae9c6dd on hv-cinder-84986 Jul 14 16:05:03.006245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-b8fca326-265c-4595-a798-d9c7aad342b7 req-3dad04d2-8355-4180-9273-5b416ccab2c3 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061077 Jul 14 16:05:03.006982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 437/876] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:03.271664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.273280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.282967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.283548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.287146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.287717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.383086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.391352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b8e02f78-4915-4a20-a27b-8c6a737a6e79 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1610 microversion: 2.1 time: 0.124132 Jul 14 16:05:03.391944 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 440/877] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1610 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:03.492072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.493716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.504779 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.505734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.514351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.514860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.549393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.550107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.550723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lazy-loading 'fault' on Instance uuid 561e084a-06c0-478e-804b-15be8ae9c6dd {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:05:03.597586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.606760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b7bd4a8-d255-43ac-a65c-810b8b04606f tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1351 microversion: 2.1 time: 0.119337 Jul 14 16:05:03.607376 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 438/878] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:03.798691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.799369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.805894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.806344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.807121 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.807554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.890491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.906822 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.909600 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.910887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-99b8c252-efad-4818-947c-3b4540739c99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1282 microversion: 2.20 time: 0.116864 Jul 14 16:05:03.911735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 441/879] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:04.409058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.409660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.423442 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.427973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.427973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.427973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.460270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.460715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.461155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lazy-loading 'fault' on Instance uuid 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:05:04.503326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.517838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d4f90259-6964-4d27-bea0-8ab3ad30a50e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 200 len: 1331 microversion: 2.1 time: 0.107573 Jul 14 16:05:04.517838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 439/880] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:04.624214 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.624885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.631463 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.631971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.632704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.633135 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.669090 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.670459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.671121 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lazy-loading 'fault' on Instance uuid 561e084a-06c0-478e-804b-15be8ae9c6dd {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:05:04.718767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad6767795b0402cb72f249b4c3a8039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.728487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-57e1e28d-88a6-46c0-8fd7-b12377ffde04 tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 200 len: 1351 microversion: 2.1 time: 0.108270 Jul 14 16:05:04.729083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 442/881] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:04.929550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.930192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.937195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.940387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.940387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.940387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.010146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.019589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.022141 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.023392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d19ba069-4319-4285-8b0a-172b2c9eeb18 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1338 microversion: 2.20 time: 0.098244 Jul 14 16:05:05.024052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 440/882] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:05.041622 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2eef8096-baf7-4c4d-a137-4ff739441756 req-dda5e76a-0c42-49e6-9201-06e3a686faa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d91ec6-f9a0-44a2-8b49-d337f3c3b36e", "name": "network-vif-deleted", "tag": "3fcbf50b-887c-4db2-b9dc-4803059614b5"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:05.050591 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2eef8096-baf7-4c4d-a137-4ff739441756 req-dda5e76a-0c42-49e6-9201-06e3a686faa5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.051038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2eef8096-baf7-4c4d-a137-4ff739441756 req-dda5e76a-0c42-49e6-9201-06e3a686faa5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.054820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:05.062562 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2eef8096-baf7-4c4d-a137-4ff739441756 req-dda5e76a-0c42-49e6-9201-06e3a686faa5 service nova] Creating event network-vif-deleted:3fcbf50b-887c-4db2-b9dc-4803059614b5 for instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e on hv-cinder-84986 Jul 14 16:05:05.067502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2eef8096-baf7-4c4d-a137-4ff739441756 req-dda5e76a-0c42-49e6-9201-06e3a686faa5 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029843 Jul 14 16:05:05.068355 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 443/883] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:05.531326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.531943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:05.542106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.542776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.543814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.544213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.560953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e HTTP/1.1 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:05:05.562805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:05:05.568935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '16d91ec6-f9a0-44a2-8b49-d337f3c3b36e'} Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:05:05.570354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:05:05.572057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.575885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:05:05.575885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-492680d9-682c-45a8-8b7c-07896d91f9b3 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 404 len: 111 microversion: 2.1 time: 0.037966 Jul 14 16:05:05.575885 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 441/884] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:05 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:05:05.577448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ef30ff4-760f-466b-aae9-351963c3168d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '.version_select at 0x7f0dc1f63670>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.747066 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.747611 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] [instance: 561e084a-06c0-478e-804b-15be8ae9c6dd] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:05.750682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ef30ff4-760f-466b-aae9-351963c3168d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722192581" status: 202 len: 0 microversion: 2.1 time: 0.180434 Jul 14 16:05:05.751523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 444/885] 10.222.0.119 () {58 vars in 1222 bytes} [Thu Jul 14 16:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722192581 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:05:05.758000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.758512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.759329 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.759875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.776092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] HTTP exception thrown: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Request method failure captured: Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd HTTP/1.1 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D1PYpXozEgC0ioLH0qIqt4so9RUFZ-D4M4nezVOBuiS4Cs2Wcv0W7CZEDBTRIHuv-eDFNUSkZjc_SdXyo9Vquxdgzna_MBBhSA-VpRmjboEfxIlQseC54162EPB9wfQHXe0OjTpDX5tD8lJNpaEBz6y5jmpgxtJJ0AKJaH9PS6Cdr8 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: cffc3cae7b014c62b9b58207cb7ef3aa Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:05:05.781216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cffc3cae7b014c62b9b58207cb7ef3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cffc3cae7b014c62b9b58207cb7ef3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cffc3cae7b014c62b9b58207cb7ef3aa", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cffc3cae7b014c62b9b58207cb7ef3aa"}]}] Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: cffc3cae7b014c62b9b58207cb7ef3aa Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1405427067 Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestMinimumBasicScenario-1405427067-project Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: aad6767795b0402cb72f249b4c3a8039 Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestMinimumBasicScenario-1405427067-project Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. Jul 14 16:05:05.783199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '561e084a-06c0-478e-804b-15be8ae9c6dd'} Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:05:05.784856 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. Jul 14 16:05:05.786412 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:05.787857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Returning 404 to user: Instance 561e084a-06c0-478e-804b-15be8ae9c6dd could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:05:05.787857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-288de020-cc2a-48ee-9a44-17fb4b08225d tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd" status: 404 len: 111 microversion: 2.1 time: 0.037508 Jul 14 16:05:05.787857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 442/886] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:05 2022] GET /compute/v2.1/servers/561e084a-06c0-478e-804b-15be8ae9c6dd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:05:05.791248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c2b05408-33e7-4725-9d23-2d6ac19b14da tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] Calling method '.version_select at 0x7f0dc1c83160>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.905406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c2b05408-33e7-4725-9d23-2d6ac19b14da tempest-TestMinimumBasicScenario-1405427067 tempest-TestMinimumBasicScenario-1405427067-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-591744031" status: 202 len: 0 microversion: 2.1 time: 0.119604 Jul 14 16:05:05.906273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 445/887] 10.222.0.119 () {58 vars in 1273 bytes} [Thu Jul 14 16:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-591744031 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:05:06.040998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:06.042223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:06.048826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.049501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.050975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.050975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.124892 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.134248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.134985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.136271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3991e124-efcb-4fd5-9d16-753bf4c59714 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1344 microversion: 2.20 time: 0.099012 Jul 14 16:05:06.137481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 443/888] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:06 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:07.065771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-686ce622-01f7-43ca-af85-7ab3b7d78b00 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: .version_select at 0x7f0dc1bbf310>, body: {"keypair": {"name": "tempest-keypair-819069300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHdCjO5Fvk553mwnB/YX+4pCx32j19c/qw791GsBDDw/Yu+19XQxcuYB3A+DFqmKy2kd6MVkYlRbM8M1W2a3LJa1qfCATpZo3hLe3POiFGopbTTuv0jlJK2Qxyd92GIAg=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:07.094020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-686ce622-01f7-43ca-af85-7ab3b7d78b00 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:07.100645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-686ce622-01f7-43ca-af85-7ab3b7d78b00 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for user 6bbbf243c1334013ac235aa5b0853621 and project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:07.159095 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:07.159701 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:07.171387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.176652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.176652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.176652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.235723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-686ce622-01f7-43ca-af85-7ab3b7d78b00 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175713 Jul 14 16:05:07.236364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 446/889] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:05:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:07.345063 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:07.358258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:07.362840 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:07.365990 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd8761e6-165b-4e02-a342-fa4f06d45d3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.209360 Jul 14 16:05:07.365990 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 444/890] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:07 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:07.418780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c4140293-3bb3-411c-8fb4-f8ef6e93816f req-9809e1df-8c28-4fc8-89c6-1cb4bdf33f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:07.432579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c4140293-3bb3-411c-8fb4-f8ef6e93816f req-9809e1df-8c28-4fc8-89c6-1cb4bdf33f0e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.433353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c4140293-3bb3-411c-8fb4-f8ef6e93816f req-9809e1df-8c28-4fc8-89c6-1cb4bdf33f0e service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.446871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c4140293-3bb3-411c-8fb4-f8ef6e93816f req-9809e1df-8c28-4fc8-89c6-1cb4bdf33f0e service nova] Creating event network-changed:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:05:07.456373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c4140293-3bb3-411c-8fb4-f8ef6e93816f req-9809e1df-8c28-4fc8-89c6-1cb4bdf33f0e service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045680 Jul 14 16:05:07.460456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 447/891] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:08.383574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:08.384370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:08.394258 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.394996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.396048 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.396926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.658606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.666506 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.668954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.670090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f3f1020-716e-41b7-8f91-e4ae6fdc9350 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.291210 Jul 14 16:05:08.670659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 445/892] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:08 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:09.690242 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:09.691648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:09.698217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.702071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.702071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.702071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.936307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.944802 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.946392 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.947682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66af53a1-3cf2-440a-80a5-cc1c7c18b115 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.262982 Jul 14 16:05:09.950977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 448/893] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:09 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:10.226401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1320841198", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0db5c9e0-6015-46b4-9562-0020fed485ab"}], "security_groups": [{"name": "tempest-securitygroup--1129597782"}], "key_name": "tempest-keypair-819069300", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:10.235361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:10.565020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] validate_networks() for [('0db5c9e0-6015-46b4-9562-0020fed485ab', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:10.966958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:10.967556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:10.973993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.974482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:10.975241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.975747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.325035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.332993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.334511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.335620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20bb0d9b-0ab7-4b54-9045-3a7dc9b707f4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.373193 Jul 14 16:05:11.336522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 449/894] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:10 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:11.344213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:11.344717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:11.345291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:11.345799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:11.346309 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:11.360551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.360551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.360551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.360551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.379117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:11.383317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Getting quotas for user 6bbbf243c1334013ac235aa5b0853621 and project 550bd9d36a324331a157f3cd2de42ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:11.394965 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:11.397260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:11.563578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf5f3207-c189-4523-b4fd-c083ccfeb79c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.342304 Jul 14 16:05:11.565499 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 446/895] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:05:10 2022] POST /compute/v2.1/servers => generated 404 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:05:11.576756 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8be44a80-bf64-4a29-8d4e-51c7600963c1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:11.577383 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8be44a80-bf64-4a29-8d4e-51c7600963c1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:11.579434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:11.640540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8be44a80-bf64-4a29-8d4e-51c7600963c1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.647961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8be44a80-bf64-4a29-8d4e-51c7600963c1 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1241 microversion: 2.1 time: 0.076146 Jul 14 16:05:11.657719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 450/896] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:11 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:12.355737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:12.356505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:12.363050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.366123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.366123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.366123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.514817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.520011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:12.526384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.529937 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.530803 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-504a6649-9fa8-4cc8-8b19-e1bd28d748c2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.179980 Jul 14 16:05:12.531555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 447/897] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:12 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:12.665405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:12.666025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:12.673789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.674242 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.675022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.675456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.757850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.765676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-525dd10d-a69d-47d0-a26d-df5c20c40aaa tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1245 microversion: 2.1 time: 0.104136 Jul 14 16:05:12.766266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 451/898] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:12 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:13.550025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:13.550803 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:13.559048 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.559494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.560295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.560852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.733205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.741272 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.742773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.743878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a611226e-db95-4a13-8378-b2b069de4e3c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.198452 Jul 14 16:05:13.744470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 448/899] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:13 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:13.783501 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:13.784207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:13.792544 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.794146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.795482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.795936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.891644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.913914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47ec6b66-c9ed-47d6-adf4-d285cde9ce48 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1293 microversion: 2.1 time: 0.134319 Jul 14 16:05:13.916495 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 452/900] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:13 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:14.034936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-4f4549de-bcdd-4c55-acba-ffa9925fb99d req-fb723c96-f50c-4480-89af-b89cf4e049e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "name": "network-vif-plugged", "status": "completed", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:14.045238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4f4549de-bcdd-4c55-acba-ffa9925fb99d req-fb723c96-f50c-4480-89af-b89cf4e049e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.045754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4f4549de-bcdd-4c55-acba-ffa9925fb99d req-fb723c96-f50c-4480-89af-b89cf4e049e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.058773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4f4549de-bcdd-4c55-acba-ffa9925fb99d req-fb723c96-f50c-4480-89af-b89cf4e049e5 service nova] Creating event network-vif-plugged:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:05:14.064188 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-4f4549de-bcdd-4c55-acba-ffa9925fb99d req-fb723c96-f50c-4480-89af-b89cf4e049e5 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Jul 14 16:05:14.064743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 449/901] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:14.765762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:14.765762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:14.770094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.770744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.771704 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.772162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.936361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:14.938255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:14.952871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.953859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.956010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.956996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.993189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.004892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.006778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.013009 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ebf7504-58ec-4560-be06-e115492e01cf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.253885 Jul 14 16:05:15.013604 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 453/902] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:14 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:15.087594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.096653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01e3ee43-2fba-41a3-8be7-3bda236fc656 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1299 microversion: 2.1 time: 0.166079 Jul 14 16:05:15.106240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 450/903] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:14 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:16.033010 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:16.033641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:16.037638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:16.042247 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.043956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.044927 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.045369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.115205 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:16.116648 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:16.125769 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.126229 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.127365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.127977 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.609739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.618504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ee1ec572-5327-4e5b-9649-23e47bf41c50 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.507438 Jul 14 16:05:16.628965 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 451/904] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:16 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:16.648531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.663365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.663365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.663365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0668f263-98ce-48db-9713-46e1e9251656 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1412 microversion: 2.20 time: 0.633113 Jul 14 16:05:16.663656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 454/905] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:16 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1412 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:16.779267 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-88efc594-174d-41ec-8930-7f06b3efc380 req-e183a0f8-0974-4fb9-84a6-d30db739a220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d937ad6-616a-435c-a539-4943f0dd69d2", "tag": "694dbef6-a3fd-4914-a121-326955167362"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:16.798743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-88efc594-174d-41ec-8930-7f06b3efc380 req-e183a0f8-0974-4fb9-84a6-d30db739a220 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.799860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-88efc594-174d-41ec-8930-7f06b3efc380 req-e183a0f8-0974-4fb9-84a6-d30db739a220 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.832664 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-88efc594-174d-41ec-8930-7f06b3efc380 req-e183a0f8-0974-4fb9-84a6-d30db739a220 service nova] Creating event network-changed:694dbef6-a3fd-4914-a121-326955167362 for instance 5d937ad6-616a-435c-a539-4943f0dd69d2 on hv-cinder-84986 Jul 14 16:05:16.841229 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-88efc594-174d-41ec-8930-7f06b3efc380 req-e183a0f8-0974-4fb9-84a6-d30db739a220 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070067 Jul 14 16:05:16.847344 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 452/906] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:17.636482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:17.637961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:17.645119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.645510 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.646293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.646857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.680787 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:17.681500 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:17.693798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.694348 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.695263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.695834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.878592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.886410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-abac2133-7790-414e-9e4b-d4e457e4e8d9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.253874 Jul 14 16:05:17.887602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 455/907] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:17 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:17.893094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1329004792", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-905132168", "security_groups": [{"name": "tempest-secgroup-smoke-1266877117"}], "networks": [{"uuid": "195d92cd-619d-400c-bff0-a6758063755b"}], "block_device_mapping_v2": [{"uuid": "ec8a8fc4-234f-4818-af61-877e9dce7105", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:17.927308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.940459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.942286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.945800 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c72fd71-e528-4d11-9645-7867e948ba43 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1603 microversion: 2.20 time: 0.268876 Jul 14 16:05:17.947590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 453/908] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:05:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:17.971359 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:17.971860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:17.978882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.979335 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.980723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.982283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.108522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] validate_networks() for [('195d92cd-619d-400c-bff0-a6758063755b', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:18.116269 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7601ff9c-003e-4649-be89-beda85077ea4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149774 Jul 14 16:05:18.116940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 454/909] 10.222.0.119 () {60 vars in 1320 bytes} [Thu Jul 14 16:05:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 16:05:18.912708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:18.913414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:18.920448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.920908 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.921693 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.922133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.005333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:19.005870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:19.006268 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:19.006736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:19.007157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:19.017778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.018231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.019092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.019533 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.043674 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Getting quotas for project 7469c47f14be40df88cc57050d28e8ba. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:19.048051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Getting quotas for user c78eff78e8564d0ba386bcd02137aa35 and project 7469c47f14be40df88cc57050d28e8ba. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:19.111526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:19.114041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec8a8fc4-234f-4818-af61-877e9dce7105',volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:19.117452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.128847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4e1f0207-5fe2-4cc8-9272-d328343eb274 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.220042 Jul 14 16:05:19.129669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 455/910] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:18 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:19.523851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5841e5e8-80cf-4d34-bb57-88a15cbbe35a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.634830 Jul 14 16:05:19.525456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 456/911] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:05:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:05:19.535729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c59dda6c-943b-48b4-80e8-bbd832758f8a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:19.536655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c59dda6c-943b-48b4-80e8-bbd832758f8a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:19.578603 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-9241d7eb-1b1e-4be8-9046-97f25694582b req-313a8bf0-8974-47d8-878d-4cb241f532e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:19.589161 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-9241d7eb-1b1e-4be8-9046-97f25694582b req-313a8bf0-8974-47d8-878d-4cb241f532e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.590106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-9241d7eb-1b1e-4be8-9046-97f25694582b req-313a8bf0-8974-47d8-878d-4cb241f532e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.607836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-9241d7eb-1b1e-4be8-9046-97f25694582b req-313a8bf0-8974-47d8-878d-4cb241f532e5 service nova] Creating event network-changed:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:05:19.613703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-9241d7eb-1b1e-4be8-9046-97f25694582b req-313a8bf0-8974-47d8-878d-4cb241f532e5 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040171 Jul 14 16:05:19.614443 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 457/912] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:19.643901 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c59dda6c-943b-48b4-80e8-bbd832758f8a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.645522 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=17 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:19.650625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c59dda6c-943b-48b4-80e8-bbd832758f8a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1091 microversion: 2.1 time: 0.119010 Jul 14 16:05:19.651362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 456/913] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:19 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1091 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:20.147647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:20.149003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:20.155915 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.156533 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.157391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.157901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.301233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:20.308886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1e903d7-968a-48a2-9993-18dbe2500938 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.165732 Jul 14 16:05:20.309697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 458/914] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:20 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:20.669482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-590cea9c-7aaa-4a69-9349-14f2fac8947b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:20.670853 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-590cea9c-7aaa-4a69-9349-14f2fac8947b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:20.734951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-590cea9c-7aaa-4a69-9349-14f2fac8947b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:20.744480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-590cea9c-7aaa-4a69-9349-14f2fac8947b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1091 microversion: 2.1 time: 0.080013 Jul 14 16:05:20.745179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 457/915] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:20 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1091 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:21.326670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:21.327341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:21.334316 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.334775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.335612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.336053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.479801 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.489438 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c30acd87-027e-4a6b-a51d-8861cef06146 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.167181 Jul 14 16:05:21.490038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 459/916] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:21 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:21.763390 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:21.764241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:21.766145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:21.771799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.772380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.773164 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.773605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.853949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.863279 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dacbd3de-c3e8-4781-b14b-d08a22510421 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1189 microversion: 2.1 time: 0.105226 Jul 14 16:05:21.864373 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 458/917] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:21 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1189 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:22.510257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:22.510880 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:22.524224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.524224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.524224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.524224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.711565 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.723971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96dbb136-7451-485b-8336-f6e04719050d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.220041 Jul 14 16:05:22.724635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 460/918] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:22 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:22.884848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:22.885477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:22.894904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.895475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.896303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.897118 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.979698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.989253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e2d74120-7812-4cd9-919b-85cee9246dba tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1207 microversion: 2.1 time: 0.110709 Jul 14 16:05:22.989847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 459/919] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:22 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1207 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:23.741463 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:23.742077 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:23.750613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.751068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.752039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.752886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.914229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.923239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab33e124-d74a-476a-97fe-b018735555c9 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.185665 Jul 14 16:05:23.927775 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 461/920] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:23 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:24.009263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:24.009904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:24.017238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.017976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.018805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.019389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.126297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-192a5eb1-d3a2-4c07-9b17-1419e49d63a5 req-00b5d4d8-cc31-48de-815e-2a0db572b8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d937ad6-616a-435c-a539-4943f0dd69d2", "name": "network-vif-plugged", "status": "completed", "tag": "694dbef6-a3fd-4914-a121-326955167362"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:24.137022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-192a5eb1-d3a2-4c07-9b17-1419e49d63a5 req-00b5d4d8-cc31-48de-815e-2a0db572b8de service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.137480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-192a5eb1-d3a2-4c07-9b17-1419e49d63a5 req-00b5d4d8-cc31-48de-815e-2a0db572b8de service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.160376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-192a5eb1-d3a2-4c07-9b17-1419e49d63a5 req-00b5d4d8-cc31-48de-815e-2a0db572b8de service nova] Creating event network-vif-plugged:694dbef6-a3fd-4914-a121-326955167362 for instance 5d937ad6-616a-435c-a539-4943f0dd69d2 on hv-cinder-84986 Jul 14 16:05:24.166307 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-192a5eb1-d3a2-4c07-9b17-1419e49d63a5 req-00b5d4d8-cc31-48de-815e-2a0db572b8de service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044783 Jul 14 16:05:24.172174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 462/921] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:24.183404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:24.191616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2245ceb6-9f46-4fac-98e2-88f493f44b67 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1275 microversion: 2.1 time: 0.186198 Jul 14 16:05:24.192334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 460/922] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:24 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:24.415313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-36c52acf-4124-4b23-a0ba-303e3f17d140 req-f6920197-dd07-4e47-9930-f727b2d1faf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:24.427871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-36c52acf-4124-4b23-a0ba-303e3f17d140 req-f6920197-dd07-4e47-9930-f727b2d1faf6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.428313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-36c52acf-4124-4b23-a0ba-303e3f17d140 req-f6920197-dd07-4e47-9930-f727b2d1faf6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.443956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-36c52acf-4124-4b23-a0ba-303e3f17d140 req-f6920197-dd07-4e47-9930-f727b2d1faf6 service nova] Creating event network-changed:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:05:24.449136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-36c52acf-4124-4b23-a0ba-303e3f17d140 req-f6920197-dd07-4e47-9930-f727b2d1faf6 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037804 Jul 14 16:05:24.449736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 463/923] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:24.940755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:24.941372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:24.947426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.947874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.949841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.950290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.076646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.083988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dba9f826-69ce-459a-9d06-4558779119d0 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.147150 Jul 14 16:05:25.084575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 461/924] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:24 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:25.209963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:25.210667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:25.218208 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.218661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.219462 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.219895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.362544 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.370191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49d76c2e-856a-4694-90d7-58b56045d28a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.165018 Jul 14 16:05:25.371868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 464/925] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:25 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:26.102218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:26.102917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:26.110121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.110566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.111330 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.111761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.240420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.248747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8b0c6ca-869e-406e-93ae-2218e2554271 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1367 microversion: 2.1 time: 0.150312 Jul 14 16:05:26.249451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 462/926] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:26 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:26.388554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:26.389168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:26.395752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.396241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.397015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.397451 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.530983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.538480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-450ad5f3-931f-4e40-886a-22fe585fb68b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.154719 Jul 14 16:05:26.539042 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 465/927] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:26 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:27.266347 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.266874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.273348 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.273801 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.274563 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.275001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.406600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:27.414113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80043f82-5849-4636-a093-61198704e20a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1554 microversion: 2.1 time: 0.152328 Jul 14 16:05:27.414794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 463/928] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:27.431258 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.431748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.438064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.438523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.439284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.439725 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.517027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05a0a7af-ff2a-4253-9765-da261b53dafd tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089529 Jul 14 16:05:27.517759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 466/929] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:27.556861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.557493 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.563584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.564025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.564826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.565256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.698451 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:27.706756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13c14885-9c86-4f5b-9aba-f72f8332a505 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.153698 Jul 14 16:05:27.707326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 464/930] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:28.723632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:28.724511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:28.731398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.731850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.732662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.733099 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.875493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:28.884768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ecd93a31-0b7f-4764-ba56-41259825dd1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.165305 Jul 14 16:05:28.886040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 467/931] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:28 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:28.900021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-5a556f4f-dca2-4032-af73-06aab7813e6b req-405ecabe-cd12-4f36-9582-ddff082bf917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d937ad6-616a-435c-a539-4943f0dd69d2", "tag": "694dbef6-a3fd-4914-a121-326955167362"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:28.908893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5a556f4f-dca2-4032-af73-06aab7813e6b req-405ecabe-cd12-4f36-9582-ddff082bf917 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.909345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5a556f4f-dca2-4032-af73-06aab7813e6b req-405ecabe-cd12-4f36-9582-ddff082bf917 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.921479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-5a556f4f-dca2-4032-af73-06aab7813e6b req-405ecabe-cd12-4f36-9582-ddff082bf917 service nova] Creating event network-changed:694dbef6-a3fd-4914-a121-326955167362 for instance 5d937ad6-616a-435c-a539-4943f0dd69d2 on hv-cinder-84986 Jul 14 16:05:28.926713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-5a556f4f-dca2-4032-af73-06aab7813e6b req-405ecabe-cd12-4f36-9582-ddff082bf917 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030109 Jul 14 16:05:28.927707 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 465/932] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:29.904748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:29.904748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:29.906520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:29.907325 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=20 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:29.912723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.918230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.918230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.918230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.940913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:30.062145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:30.070337 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54cf74f9-45bb-4324-bf16-748b61f0eb12 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.171327 Jul 14 16:05:30.070982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 468/933] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:29 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:31.084724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:31.088873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.089581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.095972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.106086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.106086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.106086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.232041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.239416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46e0c5ee-9f4b-4cd7-bead-e7485d298946 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.156101 Jul 14 16:05:31.239910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 466/934] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:31 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:31.549703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.550244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.556792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.557249 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.558016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.558520 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.584016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:05:31.942662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cdebe5b6-dec7-4370-ade3-bccbb7cc08e6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "DELETE /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 204 len: 0 microversion: 2.1 time: 0.396665 Jul 14 16:05:31.943494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 469/935] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:05:31 2022] DELETE /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:05:31.951709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.952359 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.958919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.959384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.960169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.960607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.092643 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.100137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d7234a80-242f-462f-99e1-6e126667d3e7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1580 microversion: 2.1 time: 0.152510 Jul 14 16:05:32.100714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 467/936] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:31 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:32.257173 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:32.257873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:32.263947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.264521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.265283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.265714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.397120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.405210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a96c575e-3275-4ffb-8b1b-d49cd56fbd58 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.152257 Jul 14 16:05:32.407323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 470/937] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:32 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:33.118183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:33.118767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:33.126288 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.126733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.127491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.127926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.263883 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.267247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:33.271523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5455173c-a483-40e1-b766-c045b0927915 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1580 microversion: 2.1 time: 0.157351 Jul 14 16:05:33.272090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 468/938] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:33 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:33.422175 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:33.422719 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:33.429350 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.429805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.430571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.431005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.571431 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.579518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-51751e73-c512-4805-a6f6-29526d977b1d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.161446 Jul 14 16:05:33.580082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 471/939] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:33 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:34.288945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:34.289473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:34.297394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.297880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.298650 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.299091 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.428213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:34.435912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f9703f20-854d-4415-ba4c-be4c96e8f76c tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1580 microversion: 2.1 time: 0.150903 Jul 14 16:05:34.436512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 469/940] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:34 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:34.596804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:34.597446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:34.603930 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.604402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.605160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.606296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.736789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:34.744331 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d549d5b8-2870-467e-b693-4f312088b935 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.151372 Jul 14 16:05:34.744890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 472/941] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:34 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:35.453845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:35.454473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:35.460958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.461430 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.462199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.462634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.606848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.606848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-44f86f2b-da45-444e-9cf7-6499a8554b1b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1580 microversion: 2.1 time: 0.155716 Jul 14 16:05:35.606848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 470/942] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:35 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:35.761248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:35.761932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:35.768416 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.768862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.769626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.770057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.907996 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.915762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3a4678d-8533-405e-b228-f4aa65c3c967 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.158365 Jul 14 16:05:35.916371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 473/943] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:35 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:36.623523 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:36.624770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:36.632569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f0d51197-65d8-425d-bdc1-d7d2ca59030c req-3739befa-321d-4c12-8ae8-10fe5c18ed40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdf0e60-fc39-4efd-82dc-737d584be96d", "name": "network-vif-deleted", "tag": "6a647d8b-907e-42ff-91de-7ab478625df1"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:36.646986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.646986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.646986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.646986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.651320 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f0d51197-65d8-425d-bdc1-d7d2ca59030c req-3739befa-321d-4c12-8ae8-10fe5c18ed40 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.651768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f0d51197-65d8-425d-bdc1-d7d2ca59030c req-3739befa-321d-4c12-8ae8-10fe5c18ed40 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.664381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f0d51197-65d8-425d-bdc1-d7d2ca59030c req-3739befa-321d-4c12-8ae8-10fe5c18ed40 service nova] Creating event network-vif-deleted:6a647d8b-907e-42ff-91de-7ab478625df1 for instance ffdf0e60-fc39-4efd-82dc-737d584be96d on hv-cinder-84986 Jul 14 16:05:36.670767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f0d51197-65d8-425d-bdc1-d7d2ca59030c req-3739befa-321d-4c12-8ae8-10fe5c18ed40 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041702 Jul 14 16:05:36.672045 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 474/944] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:36.719363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:36.726914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d1563f47-0516-4110-9f47-16d10a63ed8b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1513 microversion: 2.1 time: 0.108077 Jul 14 16:05:36.727486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 471/945] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:36 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:36.934046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:36.934790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:36.941573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.942021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.942788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.943221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.079152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.087143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2d0afbe8-be5a-4df1-9d23-fce64ab1b37b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.157473 Jul 14 16:05:37.087836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 475/946] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:36 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:37.750940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:37.751547 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:37.758782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.759226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.759986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.760443 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.791543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.791904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.792441 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lazy-loading 'fault' on Instance uuid ffdf0e60-fc39-4efd-82dc-737d584be96d {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:05:37.832238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.839760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-749df88d-0086-4b58-b194-730b6bc973b0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 200 len: 1234 microversion: 2.1 time: 0.092626 Jul 14 16:05:37.842886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 472/947] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:37 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:38.105088 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:38.106229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:38.113075 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.113532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.114315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.114781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.257422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:38.265397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfc3b0a7-5373-41fb-92a3-462fc18aa95f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.164356 Jul 14 16:05:38.266022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 476/948] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:38 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:38.857810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:38.858549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:38.864828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.865280 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.866071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.866505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.880668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] HTTP exception thrown: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Request method failure captured: Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d HTTP/1.1 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D3E46mK1NasiHo4tw0bqETJ3hYy2pmT_aNoVvLPYVel7Mi9RsMkYOwC4Z6bXW1752WAcCTcrX-GRXqLo_1LufWdxTfZNaV4mOCf50y5BcKjexMbCG0wb2uCvJi1ixameZJsV4ccp8YspWA0R5fXOK5qB5d5J2EQ7qI68YQxtEzpqPg Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:05:38.882332 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_1207210005f34c4aabbe6966e469c1a0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}] Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestVolumeBootPattern-158268696 Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 56191d451ddf4fba953c27dd79484723 Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:05:38.883792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'ffdf0e60-fc39-4efd-82dc-737d584be96d'} Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:05:38.884836 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:05:38.886113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:05:38.887466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Returning 404 to user: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:05:38.887466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e98ae404-8856-41c9-868c-80c18f192a3a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 404 len: 111 microversion: 2.1 time: 0.030657 Jul 14 16:05:38.887466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 473/949] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:38 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:05:38.983360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1704604799", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057527239", "security_groups": [{"name": "tempest-secgroup-smoke-695602955"}], "block_device_mapping_v2": [{"uuid": "1032730e-f7a8-407a-91af-62e9707c7820", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c436165-5659-4f64-9bb3-46eb0ae69617"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:39.092803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] validate_networks() for [('7c436165-5659-4f64-9bb3-46eb0ae69617', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:39.282646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:39.283292 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:39.292144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.292144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.292144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.292144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.771809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:39.780063 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-384e3745-f744-46fb-b4d2-b54a62182606 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.501190 Jul 14 16:05:39.780661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 474/950] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:39 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:39.791451 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:39.791925 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:39.792373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:39.792812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:39.794082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:39.802872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.803323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.804150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.804592 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.821086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:39.825133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for user 56191d451ddf4fba953c27dd79484723 and project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:39.885145 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:39.887869 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1032730e-f7a8-407a-91af-62e9707c7820',volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:40.101917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-52042d91-bb6f-47a8-9cdd-53ada65b5703 req-44fdb61b-2f61-46ad-bc3c-c6ac28aadfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "name": "network-vif-plugged", "status": "completed", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:40.112833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-52042d91-bb6f-47a8-9cdd-53ada65b5703 req-44fdb61b-2f61-46ad-bc3c-c6ac28aadfe0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:40.113275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-52042d91-bb6f-47a8-9cdd-53ada65b5703 req-44fdb61b-2f61-46ad-bc3c-c6ac28aadfe0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.128429 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-52042d91-bb6f-47a8-9cdd-53ada65b5703 req-44fdb61b-2f61-46ad-bc3c-c6ac28aadfe0 service nova] Creating event network-vif-plugged:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:05:40.133527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-52042d91-bb6f-47a8-9cdd-53ada65b5703 req-44fdb61b-2f61-46ad-bc3c-c6ac28aadfe0 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036611 Jul 14 16:05:40.134296 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 475/951] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:40.318229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-873c0d7e-15fa-457e-9bf1-6fb153cc8e81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.339497 Jul 14 16:05:40.318793 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 477/952] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:05:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:05:40.329839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-28fd87a4-ea30-494d-8556-cdf06b01ba9f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:40.330542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-28fd87a4-ea30-494d-8556-cdf06b01ba9f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:40.389566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-28fd87a4-ea30-494d-8556-cdf06b01ba9f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.398403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-28fd87a4-ea30-494d-8556-cdf06b01ba9f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1098 microversion: 2.1 time: 0.073007 Jul 14 16:05:40.399145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 476/953] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:40 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1098 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:40.797595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:40.798264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:40.805020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:40.805461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.806226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:40.806660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.941222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.948656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a22691af-ebe0-4770-b8cd-bfdc7ecbb134 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.155569 Jul 14 16:05:40.949785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 478/954] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:40 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:41.416986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:41.417587 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.420730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.428054 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.428527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.429291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.429783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.488827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:41.496545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7a8270dc-f356-4f70-a0ab-1881e712073a tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1148 microversion: 2.1 time: 0.083500 Jul 14 16:05:41.497102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 477/955] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:41 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1148 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:41.966198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:41.966844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.973492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.973945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.974888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.975522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.113560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.121813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0f72243-31c5-4f9d-ac67-3dee69a343a9 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1263 microversion: 2.1 time: 0.159426 Jul 14 16:05:42.122489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 479/956] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:41 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:42.513752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:42.514373 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:42.521923 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.522375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.523154 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.523593 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.587218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.596670 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a04e3eb-6c0d-42d7-9752-b9eff5deb151 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1196 microversion: 2.1 time: 0.087443 Jul 14 16:05:42.597238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 478/957] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:42 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1196 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:43.140263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.140871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.147293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.147752 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.148555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.148994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.297879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.305806 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb61977d-a647-4738-80c4-2c2eba6395ae tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1447 microversion: 2.1 time: 0.169848 Jul 14 16:05:43.310674 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 480/958] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:43.322317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.322918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.329377 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.329825 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.330574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.331004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.464248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.472820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c1f94fd-c488-4251-9d3e-6e23555a0270 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1447 microversion: 2.1 time: 0.154280 Jul 14 16:05:43.473395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 479/959] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:43.614916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.615595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.622111 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.622568 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.623333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.623770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.687131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.695026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5207ad8e-62e4-49f8-89af-5a9822b10705 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1196 microversion: 2.1 time: 0.083881 Jul 14 16:05:43.695606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 481/960] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:44.712458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:44.713192 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:44.720485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.721065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.721847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.722281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.916686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.938152 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d533eb5-3207-4231-9bdf-85ea19611f77 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1281 microversion: 2.1 time: 0.229681 Jul 14 16:05:44.947898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 480/961] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:44 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:45.597791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-dd4b69bc-b62c-432c-ad14-b0a31867a39f req-3e73c709-6e70-4856-9d57-223dd7fc48e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bb734-5f8d-485f-8d5e-a8aca01672ae", "tag": "d245e393-87e8-4b90-a68d-82aaa0421e63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:45.617344 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-dd4b69bc-b62c-432c-ad14-b0a31867a39f req-3e73c709-6e70-4856-9d57-223dd7fc48e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.618323 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-dd4b69bc-b62c-432c-ad14-b0a31867a39f req-3e73c709-6e70-4856-9d57-223dd7fc48e5 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.634007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-dd4b69bc-b62c-432c-ad14-b0a31867a39f req-3e73c709-6e70-4856-9d57-223dd7fc48e5 service nova] Creating event network-changed:d245e393-87e8-4b90-a68d-82aaa0421e63 for instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae on hv-cinder-84986 Jul 14 16:05:45.639326 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-dd4b69bc-b62c-432c-ad14-b0a31867a39f req-3e73c709-6e70-4856-9d57-223dd7fc48e5 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045189 Jul 14 16:05:45.645524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 482/962] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:45.827088 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-d77b64bc-adde-41ef-b6cc-3beb2ea7e283 req-38470e66-51b5-4676-a255-443a3c9ec93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:45.838986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d77b64bc-adde-41ef-b6cc-3beb2ea7e283 req-38470e66-51b5-4676-a255-443a3c9ec93d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.838986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d77b64bc-adde-41ef-b6cc-3beb2ea7e283 req-38470e66-51b5-4676-a255-443a3c9ec93d service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.849083 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-d77b64bc-adde-41ef-b6cc-3beb2ea7e283 req-38470e66-51b5-4676-a255-443a3c9ec93d service nova] Creating event network-changed:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:05:45.854051 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-d77b64bc-adde-41ef-b6cc-3beb2ea7e283 req-38470e66-51b5-4676-a255-443a3c9ec93d service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Jul 14 16:05:45.854751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 481/963] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:45.956590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:45.957543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:45.964002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.964492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.965563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.966298 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.113810 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.124240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-078628d7-5599-433e-8587-df11056c5dfc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.172221 Jul 14 16:05:46.134941 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 483/964] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:45 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:47.143644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:47.144453 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:47.150627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.151071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.151827 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.152299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.287167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.294640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd26602d-065c-4344-8d1c-f3ea6fa913f5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.155584 Jul 14 16:05:47.295194 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 482/965] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:47 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:48.312023 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:48.312669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:48.315097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:48.319859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.320342 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.321113 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.321550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.455573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:48.463549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-de46b6ae-f77f-4580-8d44-58896690eed5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.156033 Jul 14 16:05:48.464131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 484/966] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:48 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:49.480090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:49.481489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:49.488257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.488704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.489497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.489929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.624586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.633679 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99f20508-3140-4054-b696-c08c8f1e30cc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.157467 Jul 14 16:05:49.634610 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 483/967] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:49 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:50.650813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:50.651373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:50.653879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:50.654526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:50.659517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.659964 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.660805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.661271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.665507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:50.794093 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:50.801540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-71c73f6f-c405-42ce-ae9e-ab82f09c2a9d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.154734 Jul 14 16:05:50.802098 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 485/968] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:50 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:51.819520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:51.820072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:51.821985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:51.828075 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:51.828542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.829327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:51.829762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.966799 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.974187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85b7dcc7-3a66-456b-9608-17b317c29ce8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.158645 Jul 14 16:05:51.974743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 484/969] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:51 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:52.991960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:52.992604 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:52.999590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.000044 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.000904 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.001340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.130499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.138754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3798bd67-91c3-4117-848b-94b0486d68d1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.151039 Jul 14 16:05:53.139316 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 486/970] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:52 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:54.154991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:54.155589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:54.163054 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.163503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.164293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.164725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.300018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:54.307410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d6d0566e-9e43-4c2a-80a4-e69e562cf4ad tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.156712 Jul 14 16:05:54.307967 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 485/971] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:54 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:55.325270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:55.325792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:55.332367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.332816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.333574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.334005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.470374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.477846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-186e82a4-3883-447e-8700-6d024f981cc1 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.157030 Jul 14 16:05:55.478405 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 487/972] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:55 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:56.495263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:56.495812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:56.504635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.505295 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.506356 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.506845 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.639586 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:56.646995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-689332a1-2749-46eb-b0a6-c1fd8e6d436d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.156092 Jul 14 16:05:56.647565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 486/973] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:56 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:57.664868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:57.665482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:57.672123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.672577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.673338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.673774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.809276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.817268 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16fc6780-2fb0-492f-83fc-0522b8e11995 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.156435 Jul 14 16:05:57.817836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 488/974] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:57 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:58.253389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-17d7a33f-58b9-4c42-a1ec-130adc544184 req-dffebdcb-b668-48b4-8ffb-c08acccdc0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bb734-5f8d-485f-8d5e-a8aca01672ae", "name": "network-vif-plugged", "status": "completed", "tag": "d245e393-87e8-4b90-a68d-82aaa0421e63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:58.262034 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-17d7a33f-58b9-4c42-a1ec-130adc544184 req-dffebdcb-b668-48b4-8ffb-c08acccdc0e4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.262484 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-17d7a33f-58b9-4c42-a1ec-130adc544184 req-dffebdcb-b668-48b4-8ffb-c08acccdc0e4 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.273257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-17d7a33f-58b9-4c42-a1ec-130adc544184 req-dffebdcb-b668-48b4-8ffb-c08acccdc0e4 service nova] Creating event network-vif-plugged:d245e393-87e8-4b90-a68d-82aaa0421e63 for instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae on hv-cinder-84986 Jul 14 16:05:58.278313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-17d7a33f-58b9-4c42-a1ec-130adc544184 req-dffebdcb-b668-48b4-8ffb-c08acccdc0e4 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028491 Jul 14 16:05:58.278962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 487/975] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:58.834333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:58.834966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:58.841938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.842543 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.843596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.848062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.976078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.984324 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58c2603e-0f6f-48a9-9bba-6d788a5bdf07 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.153987 Jul 14 16:05:58.984897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 489/976] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:58 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:00.002532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:00.003247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:00.009578 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.010024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.010778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.011213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.141745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.145277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:00.149543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f7d71e79-175a-40eb-ad89-f0742c32c488 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1269 microversion: 2.1 time: 0.152204 Jul 14 16:06:00.150113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 488/977] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:05:59 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:01.166652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:01.167255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:01.177485 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.178233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.179513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.180279 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.314522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:01.321979 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b3a32e1-4318-4763-91ce-058473f8ac6e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1457 microversion: 2.1 time: 0.159238 Jul 14 16:06:01.322538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 490/978] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:01 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:01.338723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:01.339341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:01.348542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.348993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.349795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.350226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.480282 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:01.487957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-32dca9ba-a536-4ee5-bc37-e26f28cfc943 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1457 microversion: 2.1 time: 0.153471 Jul 14 16:06:01.488546 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 489/979] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:01 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1457 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:03.676826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-0d0bc9b3-4bec-4c90-843d-859d130b5776 req-9b4abd0e-5c07-4ecf-ae49-852aea5482e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bb734-5f8d-485f-8d5e-a8aca01672ae", "tag": "d245e393-87e8-4b90-a68d-82aaa0421e63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:03.685650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0d0bc9b3-4bec-4c90-843d-859d130b5776 req-9b4abd0e-5c07-4ecf-ae49-852aea5482e6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.686096 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0d0bc9b3-4bec-4c90-843d-859d130b5776 req-9b4abd0e-5c07-4ecf-ae49-852aea5482e6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.696881 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-0d0bc9b3-4bec-4c90-843d-859d130b5776 req-9b4abd0e-5c07-4ecf-ae49-852aea5482e6 service nova] Creating event network-changed:d245e393-87e8-4b90-a68d-82aaa0421e63 for instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae on hv-cinder-84986 Jul 14 16:06:03.703069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-0d0bc9b3-4bec-4c90-843d-859d130b5776 req-9b4abd0e-5c07-4ecf-ae49-852aea5482e6 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029845 Jul 14 16:06:03.703662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 491/980] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:04.294620 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:04.295782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:04.302838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.303298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.304086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.305194 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.330486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9df2f5f2-dabe-4282-b106-874c69861bf9 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/ips" status: 200 len: 151 microversion: 2.1 time: 0.040718 Jul 14 16:06:04.331072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 490/981] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:06:04 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:06.995676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41ed5151-0257-4016-b22d-26ccc8ef92e9"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:06.997608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:07.003778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.004270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.005039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.005480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.772120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4fecea7-6aa9-4d96-99ed-a8360d28fbdd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780492 Jul 14 16:06:07.773040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 492/982] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:06:06 2022] POST /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:16.319435 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41ed5151-0257-4016-b22d-26ccc8ef92e9"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:16.320530 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:16.322990 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=27 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:16.323763 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=10 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:16.329353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.329804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.330572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.331012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.408896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments HTTP/1.1 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 74 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:06:16.410625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {"volumeAttachment": {"volumeId": "41ed5151-0257-4016-b22d-26ccc8ef92e9"}} Jul 14 16:06:16.412328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'server_id': 'd297bd53-1291-4d7e-ac92-6bb50b22a623', 'body': {'volumeAttachment': {'volumeId': '41ed5151-0257-4016-b22d-26ccc8ef92e9'}}} Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:16.416459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:16.417730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 400 to user: Invalid volume: volume 41ed5151-0257-4016-b22d-26ccc8ef92e9 is already attached to instances: d297bd53-1291-4d7e-ac92-6bb50b22a623 {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37d75cd1-6e24-41f1-89b7-82db5d486a81 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096633 Jul 14 16:06:16.419739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 491/983] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:06:16 2022] POST /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:06:16.474159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:16.474662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:16.480936 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.481391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.482155 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.482593 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.563257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'services' on Instance uuid d297bd53-1291-4d7e-ac92-6bb50b22a623 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:06:16.772119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16993a4c-6ff9-4a0f-8a9d-a46a03a3a93e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments/41ed5151-0257-4016-b22d-26ccc8ef92e9" status: 202 len: 0 microversion: 2.1 time: 0.302596 Jul 14 16:06:16.778263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 493/984] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:06:16 2022] DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments/41ed5151-0257-4016-b22d-26ccc8ef92e9 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:06:16.781291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:16.782106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:16.788225 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.788673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.789456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.789930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.823101 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4149290f-ee9d-4c5f-a72e-e60c7a87816e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Jul 14 16:06:16.823661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 492/985] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:06:16 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:17.839753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:17.839753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:17.844845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.845293 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.846074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.846505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.891969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab2277a2-0bf5-48d9-b6e6-8d27ab7013a5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060553 Jul 14 16:06:17.892577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 494/986] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:06:17 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:18.903720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:18.904700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:18.911110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.911556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:18.912357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.912787 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.087976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-35abc087-079c-4b1c-8b2d-e56c1f006d4f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.188859 Jul 14 16:06:19.088553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 493/987] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:06:18 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:06:19.148826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:19.149352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:19.151677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=22 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:19.157334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.157714 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.158475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.158912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.183665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:06:19.434712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-275df77b-61d9-430e-8b81-ca6c8aa08b4b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 204 len: 0 microversion: 2.1 time: 0.289356 Jul 14 16:06:19.435211 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 495/988] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:06:19 2022] DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:06:19.443655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:19.444284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:19.450341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.450781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.451531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.451960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.579542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:19.587021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-51f31cd7-ebab-4539-b0c6-daf1482ee942 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1686 microversion: 2.1 time: 0.147251 Jul 14 16:06:19.587582 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 494/989] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:19 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1686 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:20.606578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:20.607368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:20.613932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.614379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.615158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.615579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.748542 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:20.756338 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-764cf44b-2d35-498b-98cc-44c13bf8c5c4 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1686 microversion: 2.1 time: 0.154749 Jul 14 16:06:20.756911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 496/990] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:20 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:21.773556 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:21.774082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:21.781520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.782144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:21.782919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.783352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:21.914573 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:21.922550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aef89e8f-45f1-428b-9aaa-bbdb0b35ea98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1686 microversion: 2.1 time: 0.153210 Jul 14 16:06:21.923310 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 495/991] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:21 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:22.943022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:22.943022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:22.961898 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:22.962348 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:22.963142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:22.963580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.027727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:23.036030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-027674b4-b089-4d55-a4a3-b8e7f0f8346d tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1619 microversion: 2.1 time: 0.099957 Jul 14 16:06:23.036638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 497/992] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:22 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1619 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:23.456348 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-14cf2bdd-e7ff-47a1-9713-03c66c5610ff req-97690d6c-efbe-4865-befe-35bfa9ac8ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d297bd53-1291-4d7e-ac92-6bb50b22a623", "name": "network-vif-deleted", "tag": "fbb35928-21d0-4314-9692-0ae8ddb46d67"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:23.464952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-14cf2bdd-e7ff-47a1-9713-03c66c5610ff req-97690d6c-efbe-4865-befe-35bfa9ac8ea7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:23.465397 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-14cf2bdd-e7ff-47a1-9713-03c66c5610ff req-97690d6c-efbe-4865-befe-35bfa9ac8ea7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.476768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-14cf2bdd-e7ff-47a1-9713-03c66c5610ff req-97690d6c-efbe-4865-befe-35bfa9ac8ea7 service nova] Creating event network-vif-deleted:fbb35928-21d0-4314-9692-0ae8ddb46d67 for instance d297bd53-1291-4d7e-ac92-6bb50b22a623 on hv-cinder-84986 Jul 14 16:06:23.482563 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-14cf2bdd-e7ff-47a1-9713-03c66c5610ff req-97690d6c-efbe-4865-befe-35bfa9ac8ea7 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Jul 14 16:06:23.483328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 496/993] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:24.053150 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:24.053813 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:24.062620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.063179 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.064256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.064699 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.067882 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:24.099864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.100345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.100798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'fault' on Instance uuid d297bd53-1291-4d7e-ac92-6bb50b22a623 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:06:24.147989 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:24.156035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-95f90839-fdd2-41cc-945a-39c08ad646ef tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 200 len: 1335 microversion: 2.1 time: 0.107138 Jul 14 16:06:24.156670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 498/994] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:24 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:25.178893 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:25.179602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:25.188321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.188924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:25.189815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.190325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:25.205536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 HTTP/1.1 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:06:25.207299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:06:25.208747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'd297bd53-1291-4d7e-ac92-6bb50b22a623'} Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:06:25.209516 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:06:25.211064 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:06:25.212638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:06:25.212638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd62b257-f96a-4b47-b55f-05c7cce632a1 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 404 len: 111 microversion: 2.1 time: 0.038793 Jul 14 16:06:25.212638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 497/995] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:25 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:06:25.219184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5da07d9f-54f1-4b36-b50a-6b31478b652a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '.version_select at 0x7f0dc1fee9d0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:25.329033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5da07d9f-54f1-4b36-b50a-6b31478b652a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413714979" status: 202 len: 0 microversion: 2.1 time: 0.114545 Jul 14 16:06:25.330049 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 499/996] 10.222.0.119 () {58 vars in 1225 bytes} [Thu Jul 14 16:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413714979 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:06:26.218835 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc86a956-2231-4d88-9510-60b817e36f12 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: .version_select at 0x7f0dc66d3310>, body: {"keypair": {"name": "tempest-keypair-188541934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3sAH2qmIYd2Eth46lqBeRcWDZiVAt0+wGLBvqtbPKpiIMBAEOGHh+MHB7L+PJULD1uWTcz0Ab0zguVf1U2fa+jJGf6QIWOJOpvRh45jEQiYKHtFCsjtQOIZxuS04uWNA=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:26.239182 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cc86a956-2231-4d88-9510-60b817e36f12 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:06:26.243113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cc86a956-2231-4d88-9510-60b817e36f12 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:06:26.333293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc86a956-2231-4d88-9510-60b817e36f12 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121835 Jul 14 16:06:26.334411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 498/997] 10.222.0.119 () {60 vars in 1163 bytes} [Thu Jul 14 16:06:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:29.280301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2095865009", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81beb021-9d5c-47cd-b940-d1c5b4031ad6"}], "security_groups": [{"name": "tempest-securitygroup--478702947"}], "key_name": "tempest-keypair-188541934", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:29.383263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] validate_networks() for [('81beb021-9d5c-47cd-b940-d1c5b4031ad6', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:06:29.757683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:06:29.758110 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:06:29.758580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:06:29.759007 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:06:29.759413 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:06:29.768551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.768998 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.769790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.770223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.786766 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:06:29.790697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Getting quotas for user b0d02887422a43e4bb69566a2d64e890 and project 4941c3a4d1be445b972c8684bc8b18d0. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:06:29.802130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:06:29.804393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:06:29.946153 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0d93a8f4-73df-4f97-98cc-eeec10e5b41e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.671980 Jul 14 16:06:29.946803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 500/998] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:06:29 2022] POST /compute/v2.1/servers => generated 403 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:06:29.957857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd0abc87-a63b-41f6-b158-3abf6bea5651 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:29.958467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd0abc87-a63b-41f6-b158-3abf6bea5651 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:30.012906 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd0abc87-a63b-41f6-b158-3abf6bea5651 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:30.019528 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd0abc87-a63b-41f6-b158-3abf6bea5651 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1245 microversion: 2.1 time: 0.066030 Jul 14 16:06:30.020286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 499/999] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:29 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:31.036708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:31.037250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:31.044602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.045055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.045833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.046277 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.110351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:31.117835 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3bb47278-e284-4c05-bf28-23d834912de2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1249 microversion: 2.1 time: 0.085301 Jul 14 16:06:31.118397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 501/1000] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:31 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:32.134334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:32.134890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:32.141338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:32.141783 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:32.142543 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:32.147926 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:32.211165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:32.219753 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4ebb2cc9-19a5-4c31-8621-62d7be516470 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1305 microversion: 2.1 time: 0.089271 Jul 14 16:06:32.220352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 500/1001] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:32 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:33.239449 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:33.240054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:33.246921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.248550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.249358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.249803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.392193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:33.399985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62552c6f-2235-4b72-ae83-589ebcf45422 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.164893 Jul 14 16:06:33.400781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 502/1002] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:33 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:34.004297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-c9193369-dca2-4298-b2b7-cfeae243aaf7 req-eb650df1-7d20-4415-bb7b-8b7e83abc992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032f2924-d847-4f21-982a-720b0bfcf434", "tag": "53d09391-9464-4b81-9f45-3bb32e261a43"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:34.015022 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c9193369-dca2-4298-b2b7-cfeae243aaf7 req-eb650df1-7d20-4415-bb7b-8b7e83abc992 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.015463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c9193369-dca2-4298-b2b7-cfeae243aaf7 req-eb650df1-7d20-4415-bb7b-8b7e83abc992 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.034236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-c9193369-dca2-4298-b2b7-cfeae243aaf7 req-eb650df1-7d20-4415-bb7b-8b7e83abc992 service nova] Creating event network-changed:53d09391-9464-4b81-9f45-3bb32e261a43 for instance 032f2924-d847-4f21-982a-720b0bfcf434 on hv-cinder-84986 Jul 14 16:06:34.039487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-c9193369-dca2-4298-b2b7-cfeae243aaf7 req-eb650df1-7d20-4415-bb7b-8b7e83abc992 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038878 Jul 14 16:06:34.040480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 501/1003] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:34.417621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:34.418232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:34.425401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.425845 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.427360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.427974 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.561711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:34.569200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7bc99b88-967f-4715-b17a-efa092b05dcc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.155515 Jul 14 16:06:34.569767 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 503/1004] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:34 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:35.587026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:35.587743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:35.594522 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:35.594964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:35.595723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:35.596183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:35.735864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:35.740511 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6cc7047-07ef-44e3-9756-e60b17892bcd tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.158211 Jul 14 16:06:35.741139 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 502/1005] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:35 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:36.758439 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:36.758967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:36.766896 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.767346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:36.768130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.768569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:37.015198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:37.022645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04293801-1657-4fc1-bcfb-e127bc6b4712 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.268342 Jul 14 16:06:37.023210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 504/1006] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:36 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:38.039024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:38.039660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:38.046363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.046805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.047560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.047991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.176035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:38.183420 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c89ae595-58cf-4c90-b99a-e9c937a3e9cc tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.148264 Jul 14 16:06:38.183942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 503/1007] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:38 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:39.199787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:39.201041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:39.207197 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.207648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.208503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.208946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.338853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:39.346577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-069355fe-1f2a-4ef8-9611-cc3f1d4c1e01 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.150606 Jul 14 16:06:39.347184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 505/1008] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:39 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:40.363273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:40.363889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:40.366390 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:40.372527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.372527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.373311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.373569 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.501583 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.509641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-94aa4fa7-41d1-408b-8f82-c6c6d477bb13 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.150270 Jul 14 16:06:40.510398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 504/1009] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:40 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:41.526854 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:41.527472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:41.530002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:41.530660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:41.535951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.536435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.537227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.537665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.683978 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.692581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1e190397-85a2-411b-846b-d070818bb8f2 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.169573 Jul 14 16:06:41.693333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 506/1010] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:41 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:42.498115 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-44d75efc-2035-45e0-b184-78e97bf20ac9 req-d9073436-d395-47c0-8801-9225eb6a892b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032f2924-d847-4f21-982a-720b0bfcf434", "name": "network-vif-plugged", "status": "completed", "tag": "53d09391-9464-4b81-9f45-3bb32e261a43"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:42.509396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-44d75efc-2035-45e0-b184-78e97bf20ac9 req-d9073436-d395-47c0-8801-9225eb6a892b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.509396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-44d75efc-2035-45e0-b184-78e97bf20ac9 req-d9073436-d395-47c0-8801-9225eb6a892b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.520296 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-44d75efc-2035-45e0-b184-78e97bf20ac9 req-d9073436-d395-47c0-8801-9225eb6a892b service nova] Creating event network-vif-plugged:53d09391-9464-4b81-9f45-3bb32e261a43 for instance 032f2924-d847-4f21-982a-720b0bfcf434 on hv-cinder-84986 Jul 14 16:06:42.525138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-44d75efc-2035-45e0-b184-78e97bf20ac9 req-d9073436-d395-47c0-8801-9225eb6a892b service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031489 Jul 14 16:06:42.525716 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 505/1011] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:42.709858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:42.710611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:42.717734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.718240 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.719045 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.719479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.852959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:42.861332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0e3593ce-07d2-4033-b7f5-9e7724725770 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.155448 Jul 14 16:06:42.862026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 507/1012] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:42 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:43.879265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:43.879999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:43.886244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.886689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:43.887454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.888426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:44.020692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:44.027949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-937b3b91-e5b3-4bea-9f75-cf02f6565590 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.153421 Jul 14 16:06:44.029262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 506/1013] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:43 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:45.044880 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:45.045482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:45.052034 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.052526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:45.053289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.053725 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:45.185739 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:45.193284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1dca02a-c2e4-4f52-a85d-0e868497436f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1370 microversion: 2.1 time: 0.152474 Jul 14 16:06:45.193862 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 508/1014] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:45 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:46.210555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:46.211156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:46.218828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:46.219275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:46.220030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:46.220487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:46.361128 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:46.368987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ec7b883-874f-476d-92d2-fba85e274cbe tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1561 microversion: 2.1 time: 0.162277 Jul 14 16:06:46.369555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 507/1015] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:06:46 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:46.388620 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:46.389232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:46.395761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:46.396243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:46.397024 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:46.397456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:46.473861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ae54e006-f6cc-4311-b346-98c91cb1eb88 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089721 Jul 14 16:06:46.474472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 509/1016] 10.222.0.119 () {58 vars in 1279 bytes} [Thu Jul 14 16:06:46 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:47.467073 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-caf27613-8437-4802-a3e9-f32f440f76a8 req-51ac8053-9764-49d0-bc79-52554fdacf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032f2924-d847-4f21-982a-720b0bfcf434", "tag": "53d09391-9464-4b81-9f45-3bb32e261a43"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:47.471651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:47.475472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-caf27613-8437-4802-a3e9-f32f440f76a8 req-51ac8053-9764-49d0-bc79-52554fdacf66 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:47.475916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-caf27613-8437-4802-a3e9-f32f440f76a8 req-51ac8053-9764-49d0-bc79-52554fdacf66 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:47.478505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=75 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:47.487936 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-caf27613-8437-4802-a3e9-f32f440f76a8 req-51ac8053-9764-49d0-bc79-52554fdacf66 service nova] Creating event network-changed:53d09391-9464-4b81-9f45-3bb32e261a43 for instance 032f2924-d847-4f21-982a-720b0bfcf434 on hv-cinder-84986 Jul 14 16:06:47.492817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-caf27613-8437-4802-a3e9-f32f440f76a8 req-51ac8053-9764-49d0-bc79-52554fdacf66 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030109 Jul 14 16:06:47.493470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 508/1017] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:06:53.311059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:53.311643 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:53.313468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:53.318270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.318729 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:53.319497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.319935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:53.344683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-116945cf-14d0-42a2-88c7-2cd3bf20a66a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/ips" status: 200 len: 151 microversion: 2.20 time: 0.038751 Jul 14 16:06:53.345266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 510/1018] 10.222.0.119 () {60 vars in 1293 bytes} [Thu Jul 14 16:06:53 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:06:56.758973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:56.759529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:56.766361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.766815 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.767577 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.768016 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.792112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lazy-loading 'flavor' on Instance uuid 1556002e-581e-4aee-880d-f517f5513652 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:06:57.466949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-40d3bedf-ec82-4a2a-aebf-5b04900dad38 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/action" status: 202 len: 0 microversion: 2.20 time: 0.712529 Jul 14 16:06:57.470560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 509/1019] 10.222.0.119 () {62 vars in 1323 bytes} [Thu Jul 14 16:06:56 2022] POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:06:57.475796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:57.476452 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:57.483456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.483903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.484715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.485149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.487889 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=66 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:57.618193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.627999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.633859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.633859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a742a45f-6020-4344-808f-36676f6c3ffc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.158918 Jul 14 16:06:57.633859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 511/1020] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:06:57 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:58.650868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:58.651487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:58.658919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.659368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.660174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.660616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.798313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:58.806425 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:58.807914 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:58.809082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aeb16aec-a345-4bca-ac84-85b7cbfe8220 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.163506 Jul 14 16:06:58.809649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 510/1021] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:06:58 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:59.828414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:59.828950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:59.835771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:59.836246 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:59.837002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:59.837432 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:59.972615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.980503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.982819 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.983992 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c68679ff-b6b7-4e37-9306-1f0aaa7258e1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.160810 Jul 14 16:06:59.984580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 512/1022] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:06:59 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:01.002877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:01.003480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:01.009999 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.010450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.011213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.011651 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.150961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.159081 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.160657 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.161807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13acef63-7a99-4314-9a39-b2fa9ff7ef3d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.162860 Jul 14 16:07:01.162363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 511/1023] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:00 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:02.180598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:02.181196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:02.187866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.188424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.189184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.189613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.319766 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.328245 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.329761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.330982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e63dc86-63bc-442a-ab85-e7f815a2516f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.154510 Jul 14 16:07:02.331551 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 513/1024] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:02 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:03.350142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:03.350745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:03.357004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.357458 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.358223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.358660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.486138 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.494005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.495505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.496672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc3ac6e7-3b73-4471-a4f3-3523ab99fff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.150710 Jul 14 16:07:03.497399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 512/1025] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:03 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:04.514963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.515573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.522506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.522938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.523696 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.524147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.660333 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.668300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.670622 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.671766 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-30197751-2f39-489c-a122-5ce68f27dd20 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.160952 Jul 14 16:07:04.672357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 514/1026] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:04 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:05.691240 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:05.697452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:05.698387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:05.698840 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:05.699609 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:05.700053 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:05.827144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:05.835082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:05.836601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:05.837754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38faab2e-cbfd-43c4-afeb-6c8ef1c7e73f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.150424 Jul 14 16:07:05.838426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 513/1027] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:05 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:06.855571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:06.856297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:06.863253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.863696 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.864476 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.864910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.993480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.002281 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.003805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.005015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8fe473e0-2631-4998-9f51-9367ceb688a1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.153336 Jul 14 16:07:07.005579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 515/1028] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:06 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:08.022839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:08.023454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:08.030917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.031361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.032135 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.032574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.163537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.171452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.172973 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.174160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2bbe2c92-1f75-40c6-9c3e-be0e91153d69 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.155264 Jul 14 16:07:08.174709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 514/1029] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:08 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:09.191797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:09.192508 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:09.199572 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.200050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.200886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.201396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.330423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.338398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.339922 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.342067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ed8cdb7-d95a-41dc-9339-e4bb6be389be tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.153253 Jul 14 16:07:09.342830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 516/1030] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:09 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:10.361145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:10.361743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:10.368222 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.368962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.369411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.369841 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.502357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.510489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.512034 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.513300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-556ff6e8-ba72-4bf3-a362-0f57e3c00dfc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.156668 Jul 14 16:07:10.513869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 515/1031] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:10 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:11.503057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:11.503639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:11.510196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.510648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.511429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.511864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.530960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:11.531575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:11.535864 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8fc2e5f5-52fc-4ff5-9380-cea6dea60c80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/ips" status: 200 len: 146 microversion: 2.1 time: 0.036809 Jul 14 16:07:11.536475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 517/1032] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:07:11 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:07:11.538351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.538812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.539589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.540029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.677927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.686601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.688080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.689278 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c570ed1-1648-4991-8e43-2de46ac70974 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.162348 Jul 14 16:07:11.689826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 516/1033] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:11 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:12.711123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:12.711809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:12.720000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.720479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.721256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.721696 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.847866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.855894 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.858260 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.859413 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1c768b42-7f85-4d5d-ac32-0f60679efb0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.152316 Jul 14 16:07:12.859962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 518/1034] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:12 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:13.877930 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:13.878531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:13.885030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.885497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.886249 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.886682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.030293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:14.038174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:14.039697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:14.040900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eaa07b6a-8a46-477c-b0ab-9f078bb6342e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.166896 Jul 14 16:07:14.041467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 517/1035] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:13 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:14.276055 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03656cae-1c45-4f95-aa87-1c2dc3f97c2d"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:14.277218 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:14.285027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.285969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.286238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.286672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.058688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:15.059283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:15.065946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.066476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.067312 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.067792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.195517 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.204014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.207946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.207946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b71d147-8578-47b9-87e3-d7394dec6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.151978 Jul 14 16:07:15.207946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 518/1036] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:15 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:15.240294 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4089e1cb-9240-42eb-9527-2eec1dca3f9f tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967931 Jul 14 16:07:15.242343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 519/1037] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:07:14 2022] POST /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:16.226364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:16.226912 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:16.233925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.234379 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.235153 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.235588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.377263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.389880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.391438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.392627 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08a369ac-9c4d-4f12-8195-330f932e896d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.170588 Jul 14 16:07:16.393311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 519/1038] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:16 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:17.411539 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:17.416426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:17.419847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.420690 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.421478 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.421918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.557404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.566015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.567531 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.568728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-88508b57-896f-4410-9696-62508a081f26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.161597 Jul 14 16:07:17.569287 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 520/1039] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:18.587056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:18.587797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:18.593651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f08c11d8-baa4-48da-bc3f-62c7dcf568f1 req-b9c1debc-68d2-48ea-8264-ae80bb69fbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "name": "network-vif-plugged", "status": "completed", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:18.596195 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.596655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.597428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.597861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.603505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f08c11d8-baa4-48da-bc3f-62c7dcf568f1 req-b9c1debc-68d2-48ea-8264-ae80bb69fbe6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.603952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f08c11d8-baa4-48da-bc3f-62c7dcf568f1 req-b9c1debc-68d2-48ea-8264-ae80bb69fbe6 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.615171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f08c11d8-baa4-48da-bc3f-62c7dcf568f1 req-b9c1debc-68d2-48ea-8264-ae80bb69fbe6 service nova] Creating event network-vif-plugged:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:07:18.620026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f08c11d8-baa4-48da-bc3f-62c7dcf568f1 req-b9c1debc-68d2-48ea-8264-ae80bb69fbe6 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Jul 14 16:07:18.620816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 521/1040] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:07:18.730713 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.739275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.740886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.742029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d00d0edb-10a4-4e19-bab2-5db0da5fbb84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.159145 Jul 14 16:07:18.742628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 520/1041] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:18 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:19.761559 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:19.762212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:19.769011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:19.769465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:19.770235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:19.770676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:19.901396 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.910180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.911708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.912910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6814d63-17c0-4a62-9fce-4456004b6e75 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.156247 Jul 14 16:07:19.913468 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 522/1042] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:19 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:20.930962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:20.931576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:20.938363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.938818 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:20.939590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.940031 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:21.067776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.076508 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.078145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.079314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f00dac1-f634-417d-9a6b-9f316025698c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.152277 Jul 14 16:07:21.079877 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 521/1043] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:20 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:22.098546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:22.099184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:22.105683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.106132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.107132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.107578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.243299 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.251385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.253112 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.254282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f386d8b7-d3a7-45ee-ad78-9f22c7dbdf0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1749 microversion: 2.20 time: 0.159674 Jul 14 16:07:22.254842 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 523/1044] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:22 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:23.271958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:23.272667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:23.284590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.284590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.284590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.284590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.418362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.427512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.429193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.430298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9999d22-6dd0-4687-b586-ff12e656b6dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.162260 Jul 14 16:07:23.431155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 522/1045] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:23 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:23.791627 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:23.792629 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:23.799990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.800480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.801287 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.801728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.832051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4411ef52-5be0-4246-9b43-313a33fc75ce tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Jul 14 16:07:23.832655 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 524/1046] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:07:23 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:23.843107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:23.843673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:23.849721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.850174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.851590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.852039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.871160 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:23.890541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ba60c4c-9d50-4b08-9f3a-c149d053f848 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d" status: 200 len: 194 microversion: 2.1 time: 0.051726 Jul 14 16:07:23.891313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 523/1047] 10.222.0.119 () {58 vars in 1417 bytes} [Thu Jul 14 16:07:23 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:07:24.451637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:24.452186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:24.458787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.459250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.460023 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.460493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.645672 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:24.655540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:24.657229 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:24.658460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a6c79ad-a85a-4a77-bbe3-5f7d0b517aee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.211860 Jul 14 16:07:24.659030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 525/1048] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:24 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:25.677025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:25.678426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:25.687960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:25.688534 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:25.689393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:25.689922 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:25.836030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.849313 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.850859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.852123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5236dead-59f6-493e-9489-4d47a32f25b0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.179240 Jul 14 16:07:25.864533 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 524/1049] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:25 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:26.676463 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96c15219-2db1-4fc5-897f-96c525cc8b45"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:26.678308 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:26.689114 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.689853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.691156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.691882 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.874880 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:26.875490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:26.877849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=34 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:26.882788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.883602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.884527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.884991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:27.012968 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:27.041173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.048406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.049913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.051071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8012c6bc-6f5a-48df-a961-207fd6babb9b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.181026 Jul 14 16:07:27.051630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 525/1050] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:26 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:27.656589 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0986f286-a301-4866-8996-eb01e24b566a tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "POST /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.984245 Jul 14 16:07:27.657816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 526/1051] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:07:26 2022] POST /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:28.070480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:28.071086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:28.078633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.079079 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.079859 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.080325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.225297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.234323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.235833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.237026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68b99fb1-5456-4a75-97d3-909e3e249ae3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.170500 Jul 14 16:07:28.237588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 526/1052] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:28 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:29.257125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:29.257886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:29.265156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.265918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.266702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.267147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.453720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.462262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.464008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.465404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-558ad4de-9065-4115-901a-7a43bcc4b2c9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.213795 Jul 14 16:07:29.467245 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 527/1053] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:29 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:30.485208 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:30.485793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:30.492852 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.493298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.494057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.494491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.650721 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.657039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.659093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.661093 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93bebc44-5082-4d75-b92d-84d218f9b446 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.179998 Jul 14 16:07:30.662013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 527/1054] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:30 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:31.681820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:31.682384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:31.688233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=36 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:31.691795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.692340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:31.693693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.694318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:31.867089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.876585 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.878572 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.879345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a93952d2-0be5-4071-9e5c-413087456e0c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.201463 Jul 14 16:07:31.880232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 528/1055] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:31 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:32.899788 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:32.900416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:32.907415 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:32.907992 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:32.909053 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:32.909491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:33.128711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.139199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.141281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.142487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-933eded2-5e3b-4d7d-9ad2-2ac8f3073db9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.247028 Jul 14 16:07:33.143307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 528/1056] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:32 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:34.163330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:34.163940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:34.170790 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.171325 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.172083 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.172548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.326526 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:34.334573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:34.336076 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:34.337251 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b343f071-3c1d-4662-9c58-7f9eec79d384 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.178202 Jul 14 16:07:34.337805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 529/1057] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:34 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:35.356187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:35.357745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:35.364119 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:35.366776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:35.366776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:35.366776 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:35.522917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.533185 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.534039 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.535497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d237593d-ef11-48e0-bb25-872acde36efb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.183108 Jul 14 16:07:35.544334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 529/1058] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:35 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:36.315356 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.316356 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.323186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.323736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.324528 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.324957 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.354808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e5b2b144-1b15-4d82-8402-25e92144e093 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043370 Jul 14 16:07:36.355367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 530/1059] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:07:36 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:36.455375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.455873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.462388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.462839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.463602 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.464041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.493173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-22480c0a-1dab-470b-991b-0088b858b5d4 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d" status: 200 len: 194 microversion: 2.1 time: 0.041679 Jul 14 16:07:36.493735 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 530/1060] 10.222.0.119 () {58 vars in 1417 bytes} [Thu Jul 14 16:07:36 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:07:36.504028 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.504564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.510743 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.511203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.511992 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.512489 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.553891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.554505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.562013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.562474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.563262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.563706 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.595067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lazy-loading 'services' on Instance uuid 5d937ad6-616a-435c-a539-4943f0dd69d2 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:07:36.699118 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.707723 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.709324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.710494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-101cd772-2c53-4d5f-be02-830d55492f84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1744 microversion: 2.20 time: 0.160553 Jul 14 16:07:36.711056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 531/1061] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:36 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:36.859159 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c48e2ef6-94a0-4ef4-8280-6ff7b7a748dc tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d" status: 202 len: 0 microversion: 2.1 time: 0.358794 Jul 14 16:07:36.859760 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 531/1062] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:07:36 2022] DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/03656cae-1c45-4f95-aa87-1c2dc3f97c2d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:07:37.728654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:37.729265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:37.736672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.737125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.737898 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.738364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.871955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.881545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.883049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.884257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-daa101ec-004a-42c2-ba05-f9256c5c4ed5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1726 microversion: 2.20 time: 0.159512 Jul 14 16:07:37.884810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 532/1063] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:37 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:38.902840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:38.903595 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:38.910015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:38.916499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:38.916499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:38.916499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.038024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:39.039033 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:39.046572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.047177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.048113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.048697 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.084485 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ecd3f29-2265-4acb-9c56-7f814f16bd5c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/96c15219-2db1-4fc5-897f-96c525cc8b45" status: 200 len: 194 microversion: 2.1 time: 0.050881 Jul 14 16:07:39.085228 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 533/1064] 10.222.0.119 () {58 vars in 1417 bytes} [Thu Jul 14 16:07:39 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/96c15219-2db1-4fc5-897f-96c525cc8b45 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:39.128490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:39.129011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:39.135288 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.135740 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.136632 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.137069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.222028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lazy-loading 'services' on Instance uuid 5d937ad6-616a-435c-a539-4943f0dd69d2 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:07:39.315455 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.323518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.325089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.326841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f423885e-ef39-4440-ba10-7e6e19fbed23 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1726 microversion: 2.20 time: 0.429194 Jul 14 16:07:39.327412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 532/1065] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:38 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1726 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:39.487117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-50b97390-0c15-482e-8c16-51fb8140ba27 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/96c15219-2db1-4fc5-897f-96c525cc8b45" status: 202 len: 0 microversion: 2.1 time: 0.363217 Jul 14 16:07:39.487636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 534/1066] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:07:39 2022] DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments/96c15219-2db1-4fc5-897f-96c525cc8b45 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:07:40.345770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:40.346371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:40.352982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.353434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.354198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.354630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.485129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.494842 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.496376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.497780 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f97ac45b-3c9f-496b-b5d0-e03c373eb5d3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1726 microversion: 2.20 time: 0.156168 Jul 14 16:07:40.498436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 533/1067] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:40 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:40.661401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-ef6581f1-4c7d-4639-a22b-b7ff7a50db65 req-bb366bcf-8f47-4fe4-bdb6-110d255182db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "name": "network-vif-unplugged", "status": "completed", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:40.669838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ef6581f1-4c7d-4639-a22b-b7ff7a50db65 req-bb366bcf-8f47-4fe4-bdb6-110d255182db service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.670291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ef6581f1-4c7d-4639-a22b-b7ff7a50db65 req-bb366bcf-8f47-4fe4-bdb6-110d255182db service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.681603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-ef6581f1-4c7d-4639-a22b-b7ff7a50db65 req-bb366bcf-8f47-4fe4-bdb6-110d255182db service nova] Creating event network-vif-unplugged:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:07:40.686874 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-ef6581f1-4c7d-4639-a22b-b7ff7a50db65 req-bb366bcf-8f47-4fe4-bdb6-110d255182db service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088844 Jul 14 16:07:40.687465 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 535/1068] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:41.518345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.518970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.526367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.526832 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.527603 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.528165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.674706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.682745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.684282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.686519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-397829fa-0673-49d6-8abe-7f77891c6249 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1729 microversion: 2.20 time: 0.174602 Jul 14 16:07:41.687089 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 534/1069] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:41.707785 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7b572dd-a77b-4e05-a6b1-c4acdd6959c4"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:41.709567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.716161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.716617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.717851 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.718220 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.719265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.720977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.729255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.729781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.730571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.731006 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.766623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8dfcdffe-6e07-44c3-a35a-9490c6beabf2 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052594 Jul 14 16:07:41.771861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 535/1070] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:07:41.884434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.884434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.889213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.889657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.890888 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.891515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.922192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05ea7774-1697-40b1-9f8e-1c4467fb7b6c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044027 Jul 14 16:07:41.922759 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 536/1071] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:07:41.987933 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.990312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.994701 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.995148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.995946 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.996406 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.024128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:07:42.330828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cee38d80-ce09-42e9-bf3d-79753cba405e tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 204 len: 0 microversion: 2.1 time: 0.345944 Jul 14 16:07:42.331663 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 537/1072] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:07:41 2022] DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:07:42.343111 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:42.343807 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:42.350110 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.350625 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.351390 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.351822 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.533282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.540928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f942bc0-67ea-4b09-b181-e1a7202bb459 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1678 microversion: 2.1 time: 0.203813 Jul 14 16:07:42.541492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 538/1073] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:42 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:42.733029 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4c6d2e7d-2642-4078-8c99-146b289d869e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.030016 Jul 14 16:07:42.733813 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 536/1074] 10.222.0.119 () {62 vars in 1368 bytes} [Thu Jul 14 16:07:41 2022] POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments => generated 188 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:07:42.859267 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:42.859841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:42.865968 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.866418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.867189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.867628 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.989169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:43.215660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-08ace4b2-bc56-4ae4-8d6d-e8b80bb3e9f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/action" status: 202 len: 0 microversion: 2.20 time: 0.360657 Jul 14 16:07:43.216278 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 539/1075] 10.222.0.119 () {62 vars in 1323 bytes} [Thu Jul 14 16:07:42 2022] POST /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:07:43.224725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:43.225339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:43.232654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.233439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.234307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.234806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.250515 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:43.374995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.383340 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.384991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.388319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d69d8e71-e60d-418d-9c80-50d94234ddd3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1755 microversion: 2.20 time: 0.165423 Jul 14 16:07:43.388319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 537/1076] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:43 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:43.558921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:43.559579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:43.568169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.574412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.574412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.574412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.739644 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.747198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-abf2772a-69a0-4b13-b103-b7ea608b1d28 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1678 microversion: 2.1 time: 0.192787 Jul 14 16:07:43.748194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 540/1077] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:43 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:44.409152 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:44.409787 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:44.418325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.418760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.420214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.420662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.577998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.586903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.588876 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.590409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0e274ce-b7ff-46f4-8b71-13fa8d03cf5a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1755 microversion: 2.20 time: 0.185094 Jul 14 16:07:44.591122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 538/1078] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:44 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:44.766073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:44.766938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:44.773648 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.774094 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.774853 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.775286 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.915464 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.926163 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55ff45f3-19c7-4697-9958-e0b8f70d4fd5 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1678 microversion: 2.1 time: 0.164578 Jul 14 16:07:44.929160 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 541/1079] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:44 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:45.611083 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:45.611920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:45.620368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.621068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.623027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.623027 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.772571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:45.781687 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:45.784307 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:45.784959 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-44fc99ea-5f3d-4274-b26a-87e33f8b26d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1757 microversion: 2.20 time: 0.177954 Jul 14 16:07:45.785514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 539/1080] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:45 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:45.944491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:45.951494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:45.952456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.952911 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.953872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.954302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.023412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.036711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ee818005-e52e-49e5-a897-05358f71ea80 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1610 microversion: 2.1 time: 0.095587 Jul 14 16:07:46.038110 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 542/1081] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:45 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1610 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:46.236393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-74a3fae2-2157-4427-aaa9-cf9d2d76ab0c req-847d0ddd-e953-4de2-a1e2-e5ba7f5d59d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d937ad6-616a-435c-a539-4943f0dd69d2", "name": "network-vif-deleted", "tag": "694dbef6-a3fd-4914-a121-326955167362"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:46.246860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-74a3fae2-2157-4427-aaa9-cf9d2d76ab0c req-847d0ddd-e953-4de2-a1e2-e5ba7f5d59d1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.248471 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-74a3fae2-2157-4427-aaa9-cf9d2d76ab0c req-847d0ddd-e953-4de2-a1e2-e5ba7f5d59d1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.264396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-74a3fae2-2157-4427-aaa9-cf9d2d76ab0c req-847d0ddd-e953-4de2-a1e2-e5ba7f5d59d1 service nova] Creating event network-vif-deleted:694dbef6-a3fd-4914-a121-326955167362 for instance 5d937ad6-616a-435c-a539-4943f0dd69d2 on hv-cinder-84986 Jul 14 16:07:46.270532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-74a3fae2-2157-4427-aaa9-cf9d2d76ab0c req-847d0ddd-e953-4de2-a1e2-e5ba7f5d59d1 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040947 Jul 14 16:07:46.271789 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 540/1082] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:46.802849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:46.803574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:46.810166 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.810892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.811669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.812125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.955064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.966523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.966523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.968018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b598a4dd-feb2-44fd-b994-ec3f82b9fed3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1757 microversion: 2.20 time: 0.169133 Jul 14 16:07:46.968598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 543/1083] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:46 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:47.059463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:47.060244 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:47.067756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.075013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.075013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.075013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.106069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.106587 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.107726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lazy-loading 'fault' on Instance uuid 5d937ad6-616a-435c-a539-4943f0dd69d2 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:07:47.156762 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbbf243c1334013ac235aa5b0853621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550bd9d36a324331a157f3cd2de42ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.166021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20f82000-b700-4579-8fae-0ecc534c9132 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 200 len: 1331 microversion: 2.1 time: 0.110773 Jul 14 16:07:47.167104 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 541/1084] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:47 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:47.987276 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:47.987890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:47.994465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.994932 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.995710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.996175 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.139770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.149041 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.150984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.152174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-53b38aa2-e0eb-4102-8657-8c01f9af02ee tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.169073 Jul 14 16:07:48.152792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 544/1085] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:47 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:48.184243 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:48.185635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:48.192363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.192830 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.193684 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.194163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.208405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 HTTP/1.1 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:07:48.210084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:48.211731 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '5d937ad6-616a-435c-a539-4943f0dd69d2'} Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:48.212708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:48.214308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:48.215724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:48.215724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-10a4b7fe-6b59-42c8-a90a-703b35686474 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 404 len: 111 microversion: 2.1 time: 0.032135 Jul 14 16:07:48.216189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 542/1086] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:48 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:48.221371 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a4bf8e1-0348-45e6-a7e6-4da6db30fecb tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '.version_select at 0x7f0dc1fee5e0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:48.351764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a4bf8e1-0348-45e6-a7e6-4da6db30fecb tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-819069300" status: 202 len: 0 microversion: 2.1 time: 0.134403 Jul 14 16:07:48.352397 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 545/1087] 10.222.0.119 () {58 vars in 1222 bytes} [Thu Jul 14 16:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-819069300 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:07:49.170701 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:49.171588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:49.178077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.178745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.179809 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.181071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.375236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.385575 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.387426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.389175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b262cba-dea2-4465-874f-213bcacb9a0b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.222691 Jul 14 16:07:49.390308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 543/1088] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:49 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:50.408604 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:50.409236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:50.416343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.416871 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.417848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.418285 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.567491 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.584949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.586471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.587650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25a2e66a-9f20-437b-ba7e-ff386414fd42 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.184110 Jul 14 16:07:50.592745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 546/1089] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:50 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:51.612362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.613250 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.622253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.623380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.624453 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.624890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.764026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.772777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.774293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.775454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85c17d47-15af-41e6-854f-451b2953cba7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.171741 Jul 14 16:07:51.776012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 544/1090] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:51 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:51.867666 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.867666 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.870561 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.871014 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.871792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.872250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.887417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 HTTP/1.1 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:07:51.889768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.891394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '5d937ad6-616a-435c-a539-4943f0dd69d2'} Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:51.892273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.893499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.894726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:51.894726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-237d69f7-85c6-4238-8d28-3ebb1bf6d30d tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 404 len: 111 microversion: 2.1 time: 0.032067 Jul 14 16:07:51.894726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 547/1091] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:07:51 2022] DELETE /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:51.900339 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.900944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 5d937ad6-616a-435c-a539-4943f0dd69d2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.907441 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.908015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.908960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.909511 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.925982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 HTTP/1.1 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:07:51.927722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.929352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '5d937ad6-616a-435c-a539-4943f0dd69d2'} Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:51.930248 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. Jul 14 16:07:51.932919 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:51.936052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 5d937ad6-616a-435c-a539-4943f0dd69d2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:51.936052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23c6a8c2-a341-40ad-86fe-151a345cd3c6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2" status: 404 len: 111 microversion: 2.1 time: 0.037064 Jul 14 16:07:51.936052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 545/1092] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:51 2022] GET /compute/v2.1/servers/5d937ad6-616a-435c-a539-4943f0dd69d2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:52.795814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:52.796652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:52.802986 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.803442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.804465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.804827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.952470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.961220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.963000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.964335 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f6f0c358-3170-4ab7-a3b0-62abc3c6158a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.173485 Jul 14 16:07:52.964884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 548/1093] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:52 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:53.239054 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.239561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.246239 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.246689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.247453 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.247939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.261426 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e HTTP/1.1 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:07:53.262970 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.264615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '16d91ec6-f9a0-44a2-8b49-d337f3c3b36e'} Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:53.265372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.266837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.268321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:53.268321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-411d06cc-4a0c-48b4-ae35-8fadc690b1d6 tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 404 len: 111 microversion: 2.1 time: 0.029301 Jul 14 16:07:53.268321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 546/1094] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:07:53 2022] DELETE /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:53.273310 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.273931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] [instance: 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.280999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.281720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.282764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.283306 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.299340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] HTTP exception thrown: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Request method failure captured: Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e HTTP/1.1 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyydMP6mCozu3xSc1UMFHWVIZU0IYRsQLNmmjLj52lfTpGOS7yf6M74FOEJQWpQM56-W1ZEDo-po86P_4lHk2RCvVuHuuTq0fsHsCQiGgcgSW3CtTXe_pssbFyeORV7z30odh1MBofe245l_d5aDjvxztX1HZHzRzNRy2q5GBgZDcQ Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:07:53.301128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/550bd9d36a324331a157f3cd2de42ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_550bd9d36a324331a157f3cd2de42ca3", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/550bd9d36a324331a157f3cd2de42ca3"}]}] Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 550bd9d36a324331a157f3cd2de42ca3 Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2040684758 Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 6bbbf243c1334013ac235aa5b0853621 Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeTestJSON-2040684758-project Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.302834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '16d91ec6-f9a0-44a2-8b49-d337f3c3b36e'} Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:53.303765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. Jul 14 16:07:53.305125 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:07:53.309221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] Returning 404 to user: Instance 16d91ec6-f9a0-44a2-8b49-d337f3c3b36e could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:53.310499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-41032d45-7fb3-473a-b914-40bf4eec924c tempest-AttachVolumeTestJSON-2040684758 tempest-AttachVolumeTestJSON-2040684758-project] 10.222.0.119 "GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e" status: 404 len: 111 microversion: 2.1 time: 0.040482 Jul 14 16:07:53.311637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 549/1095] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:07:53 2022] GET /compute/v2.1/servers/16d91ec6-f9a0-44a2-8b49-d337f3c3b36e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:53.984951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.986006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.992541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.993293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.994276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.994975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:54.227982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.239168 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.241550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.243070 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-501641a1-3064-40b0-ac5e-67311794566a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.264186 Jul 14 16:07:54.253603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 547/1096] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:53 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:55.270740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:55.271999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:55.293691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.296071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.297181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.298493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.871877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:55.882500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:55.884370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:55.885958 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d32a250d-da1a-4b9a-ab22-a1bdfb7da234 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.619198 Jul 14 16:07:55.886927 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 550/1097] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:55 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:56.907189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:56.907858 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:56.915001 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:56.915410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:56.916424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:56.917024 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:57.113878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.123805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.125438 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.127238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-12bbc882-6cce-4e8e-97a9-3b4073d26ad2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.224839 Jul 14 16:07:57.128584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 548/1098] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:56 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:58.147267 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:58.148182 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:58.156962 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.157826 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:58.158689 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.159301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:58.306001 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.317137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.319130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.321409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-37309bf0-7174-45ae-ba1b-f6785e18882a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.178186 Jul 14 16:07:58.322878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 551/1099] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:58 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:59.343116 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:59.343701 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:59.346338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=50 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:59.351057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:59.351502 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:59.352324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:59.352793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:59.487563 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.495935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.497665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.499097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68aa84d1-c297-4822-a1e0-a33abbcf57d2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.160293 Jul 14 16:07:59.499654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 549/1100] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:07:59 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:00.135351 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a05dfd8a-0a08-4cd7-b6cf-6f2a97293375 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Action: 'create', calling method: .version_select at 0x7f0dc1f89160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-533825558", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:00.517733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:00.517733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:00.524450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.525030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.525944 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.526411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.663158 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.673681 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.675903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.676387 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3fb416c8-da1f-499a-ade3-c0e2c42567ed tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.163248 Jul 14 16:08:00.676952 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 550/1101] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:00 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:00.733821 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a05dfd8a-0a08-4cd7-b6cf-6f2a97293375 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.718185 Jul 14 16:08:00.734459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 552/1102] 10.222.0.119 () {60 vars in 1160 bytes} [Thu Jul 14 16:08:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 719 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 14 16:08:00.745480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8a7307d-f845-41c6-a5ae-2af3026413d0 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1e56f70>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:00.802113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8a7307d-f845-41c6-a5ae-2af3026413d0 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 352 microversion: 2.1 time: 0.060410 Jul 14 16:08:00.802690 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 551/1103] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:00 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:01.694773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:01.695525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:01.701990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.702446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.703237 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.703671 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.815692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ea4e5ce-d4d9-4f88-b271-7913b500ffcd tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1e49820>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:01.843912 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.853326 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.855347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.856713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65c20374-4873-4691-a491-94840364cd2c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.166487 Jul 14 16:08:01.857609 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 553/1104] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:01 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:01.870154 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ea4e5ce-d4d9-4f88-b271-7913b500ffcd tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 352 microversion: 2.1 time: 0.059170 Jul 14 16:08:01.870724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 552/1105] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:01 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:02.875601 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:02.876234 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:02.878580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:02.883439 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.883603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-753bcdf0-d807-4874-8b3c-7ccb92137cb5 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc205a550>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:02.884018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.884666 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.885104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.932820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-753bcdf0-d807-4874-8b3c-7ccb92137cb5 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 353 microversion: 2.1 time: 0.053553 Jul 14 16:08:02.933405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 553/1106] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:02 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:02.944636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2b9717e4-f1c7-48e8-89a7-78d904a2e9a0 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1e491f0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:02.994717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2b9717e4-f1c7-48e8-89a7-78d904a2e9a0 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 353 microversion: 2.1 time: 0.053923 Jul 14 16:08:02.995306 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 554/1107] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:02 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:03.007452 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-43998c77-aad9-4252-9977-abddac885dd3 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1e493a0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:03.023913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.034913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.036469 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.037783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5d41b9ea-f10c-4f4b-84bd-5787092a23b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.166924 Jul 14 16:08:03.038347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 554/1108] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:02 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:03.237739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-43998c77-aad9-4252-9977-abddac885dd3 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 202 len: 0 microversion: 2.1 time: 0.233910 Jul 14 16:08:03.238315 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 555/1109] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:08:03 2022] DELETE /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:03.246610 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5abbec42-b89f-4a8d-8a6b-21ed75b70538 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1c83a60>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:03.296230 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5abbec42-b89f-4a8d-8a6b-21ed75b70538 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 352 microversion: 2.1 time: 0.053498 Jul 14 16:08:03.296798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 555/1110] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:03 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:04.059123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:04.061065 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:04.068371 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.068820 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.069791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.070261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.219725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.228159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.229674 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.230829 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-592d6eed-073d-45bb-9b3c-9358c7dcb473 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.176975 Jul 14 16:08:04.231392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 556/1111] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:04 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:04.309444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8a0b4d0-0f10-4235-9b03-daccc734a872 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1fee8b0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:04.357252 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8a0b4d0-0f10-4235-9b03-daccc734a872 tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 200 len: 352 microversion: 2.1 time: 0.052185 Jul 14 16:08:04.358005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 556/1112] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:04 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:05.249920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:05.250509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:05.257294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:05.257772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:05.258623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:05.259090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:05.370212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-90a30421-3d0b-4671-a61f-798ee95fb96b tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Calling method '.version_select at 0x7f0dc1f92700>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:05.393496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.400721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-90a30421-3d0b-4671-a61f-798ee95fb96b tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] HTTP exception thrown: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. Jul 14 16:08:05.402141 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-90a30421-3d0b-4671-a61f-798ee95fb96b tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Request method failure captured: Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 HTTP/1.1 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D9fC9NtKX29HXwLqEuM0SeyiI5UtK0JtFr19OzAmuVi60ufJ-bl1ASEbIhZ4BvJd53ufXZZwG7wlH1ElCS3CehzchNGkmRlMQiMma_oE-ssZC9KfRsEO9oZII3HEEED94EORzD_etNPKsWlZM18Z5Jf8WNSuKMZmhBy8HpdY9EjTAg Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 7938bf23083846c2a3c51dd5184d6747 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesGetTestJSON-1757542886 Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:05.402868 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7938bf23083846c2a3c51dd5184d6747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7938bf23083846c2a3c51dd5184d6747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7938bf23083846c2a3c51dd5184d6747", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7938bf23083846c2a3c51dd5184d6747"}]}] Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesGetTestJSON-1757542886 Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 7938bf23083846c2a3c51dd5184d6747 Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesGetTestJSON-1757542886 Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesGetTestJSON-1757542886-project Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: c71382751acf4cefaed60144b84894a2 Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesGetTestJSON-1757542886-project Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '006df6d9-0387-487c-b661-71fb3d6a6dc8'} Jul 14 16:08:05.405271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. (HTTP 404) (Request-ID: req-d3bd660d-ba6a-41c4-8663-63840894fe80) Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:05.406169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:08:05.407395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:08:05.412828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:05.414289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-90a30421-3d0b-4671-a61f-798ee95fb96b tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] Returning 404 to user: Volume 006df6d9-0387-487c-b661-71fb3d6a6dc8 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:05.415201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.415320 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-90a30421-3d0b-4671-a61f-798ee95fb96b tempest-VolumesGetTestJSON-1757542886 tempest-VolumesGetTestJSON-1757542886-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8" status: 404 len: 109 microversion: 2.1 time: 0.039294 Jul 14 16:08:05.415427 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c3e37e0d-6f10-4b02-9477-55d12db29d09 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.160388 Jul 14 16:08:05.415535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 557/1113] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:05 2022] GET /compute/v2.1/os-volumes/006df6d9-0387-487c-b661-71fb3d6a6dc8 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:08:05.415628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 557/1114] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:05 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:06.430042 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:06.430737 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:06.437596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:06.438122 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:06.438951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:06.439454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:06.574615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:06.583776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:06.585448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:06.586667 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1454a9b-352c-44fe-a421-07d3b9a26163 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.160662 Jul 14 16:08:06.587221 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 558/1115] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:06 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:07.605018 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:07.605680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:07.613122 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.613571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.614338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.614951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.744810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.753357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.754967 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.756146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81699a48-983c-48e2-9c24-8d0778f7d852 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.155026 Jul 14 16:08:07.756709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 558/1116] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:07 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:08.774781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:08.775329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:08.782861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.783343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.784212 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.784651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.916347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.925262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.926768 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.927949 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a2eaa3a-0fe9-43b1-8ede-b6ce2ed001d8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.157222 Jul 14 16:08:08.928546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 559/1117] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:08 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:09.131056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b8d8ede-301c-407c-b19f-3735eb474b4e tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1ecbc10>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:09.178683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b8d8ede-301c-407c-b19f-3735eb474b4e tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/fa188b6e-ac98-4782-b9d5-6cfe47e0a50e" status: 200 len: 350 microversion: 2.1 time: 0.051347 Jul 14 16:08:09.179256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 559/1118] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:09 2022] GET /compute/v2.1/os-volumes/fa188b6e-ac98-4782-b9d5-6cfe47e0a50e => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:09.946869 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:09.947483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:09.954536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.954981 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:09.955816 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.956283 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:10.086088 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.094948 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.096525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.097677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cdda0470-6fb1-4399-9062-cb2a85135458 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.154806 Jul 14 16:08:10.098231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 560/1119] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:09 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:10.872906 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a68fb1d-5f72-4e7b-aa2e-9e5d61811296 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1e778b0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:10.921956 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a68fb1d-5f72-4e7b-aa2e-9e5d61811296 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/9330b1ac-1b2b-41f2-b671-f140a11e4b30" status: 200 len: 351 microversion: 2.1 time: 0.053458 Jul 14 16:08:10.922540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 560/1120] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:10 2022] GET /compute/v2.1/os-volumes/9330b1ac-1b2b-41f2-b671-f140a11e4b30 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:11.116332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:11.116942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:11.124137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.129067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:11.129067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.129067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:11.257408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.265928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.267431 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.268710 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e82cdbdd-bf9c-448a-99c0-4ce2ab71bef2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.156387 Jul 14 16:08:11.269271 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 561/1121] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:11 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:12.287467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:12.287998 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:12.294849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:12.295283 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.296049 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:12.296514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.427329 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.435861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.437850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.438689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-88be5a30-4fe9-401d-803d-18e035b0df99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.155824 Jul 14 16:08:12.439241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 561/1122] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:12 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:12.852073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-b7493892-d471-4fe2-b507-81e2b8eaea4e req-7862c3f3-95b4-4e4f-abdb-69f1bfa228a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "name": "network-vif-plugged", "status": "completed", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:12.861529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b7493892-d471-4fe2-b507-81e2b8eaea4e req-7862c3f3-95b4-4e4f-abdb-69f1bfa228a2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:12.861975 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b7493892-d471-4fe2-b507-81e2b8eaea4e req-7862c3f3-95b4-4e4f-abdb-69f1bfa228a2 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.873169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-b7493892-d471-4fe2-b507-81e2b8eaea4e req-7862c3f3-95b4-4e4f-abdb-69f1bfa228a2 service nova] Creating event network-vif-plugged:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:08:12.878347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-b7493892-d471-4fe2-b507-81e2b8eaea4e req-7862c3f3-95b4-4e4f-abdb-69f1bfa228a2 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029933 Jul 14 16:08:12.878935 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 562/1123] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:13.455740 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.456460 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:13.462942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.463397 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.465993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.465993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.543563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4d7ac90-453c-4130-a6ac-307f96bd1d26 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1c1f820>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.598147 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4d7ac90-453c-4130-a6ac-307f96bd1d26 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/3c49899a-b353-415d-b4f6-3bcebe5462b2" status: 200 len: 351 microversion: 2.1 time: 0.059229 Jul 14 16:08:13.605114 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 563/1124] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes/3c49899a-b353-415d-b4f6-3bcebe5462b2 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:13.611980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eb543911-d2ee-474b-8209-88a07d8c7038 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1e0d790>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.626097 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.633334 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.635015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.636245 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c70ac292-a63e-4f8b-a408-0eb5a75ec878 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.184407 Jul 14 16:08:13.636810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 562/1125] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:13.693492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eb543911-d2ee-474b-8209-88a07d8c7038 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087046 Jul 14 16:08:13.694050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 564/1126] 10.222.0.119 () {58 vars in 1138 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:13.706041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b2697335-59b5-47db-a60a-e8aa779bae29 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1f12280>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.786688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b2697335-59b5-47db-a60a-e8aa779bae29 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084420 Jul 14 16:08:13.787262 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 563/1127] 10.222.0.119 () {58 vars in 1153 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:13.799040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a114f6b2-588d-4126-856e-99b0d470ca21 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1c96820>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.881703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a114f6b2-588d-4126-856e-99b0d470ca21 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086144 Jul 14 16:08:13.882753 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 565/1128] 10.222.0.119 () {58 vars in 1138 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:13.894817 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e1585293-305c-4bae-bb97-572a0510fe62 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1d5a1f0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.978729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e1585293-305c-4bae-bb97-572a0510fe62 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087702 Jul 14 16:08:13.979294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 564/1129] 10.222.0.119 () {58 vars in 1171 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:13.990821 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3d473e8-6c95-4748-93f2-e50aabeeb78e tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1c96f70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.073470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f3d473e8-6c95-4748-93f2-e50aabeeb78e tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086200 Jul 14 16:08:14.074036 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 566/1130] 10.222.0.119 () {58 vars in 1174 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:14.086364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-97ed6b7b-f1e8-471a-9db8-2fe3e05f4ec3 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1ecb820>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.166928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-97ed6b7b-f1e8-471a-9db8-2fe3e05f4ec3 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084264 Jul 14 16:08:14.167500 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 565/1131] 10.222.0.119 () {58 vars in 1159 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:14.178918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7b45fa3-f178-41cd-9556-43fe612d3e65 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1e0d3a0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.260193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7b45fa3-f178-41cd-9556-43fe612d3e65 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084910 Jul 14 16:08:14.260765 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 567/1132] 10.222.0.119 () {58 vars in 1192 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:14.273495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b81a8f37-4c18-4695-b5c3-8c485d502477 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] Calling method '.version_select at 0x7f0dc1e77430>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.507457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b81a8f37-4c18-4695-b5c3-8c485d502477 tempest-VolumesTestJSON-1528973943 tempest-VolumesTestJSON-1528973943-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237637 Jul 14 16:08:14.508298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 566/1133] 10.222.0.119 () {58 vars in 1159 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:14.655493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.656158 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:14.663181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.663622 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.664404 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.664837 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.667578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:14.802459 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:14.811899 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:14.813502 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:14.814686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-650fedcb-6c07-4bbd-8ca5-02b63965a6b7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.164063 Jul 14 16:08:14.815231 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 568/1134] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:15.838152 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:15.838795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:15.846757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.847218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.848050 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.848519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.851367 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:15.930391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:08:15.930611 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 (ip 10.222.0.119) !!! Jul 14 16:08:15.990179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.999154 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.000794 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.012536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-827644f1-1f01-4f7d-87ce-227f2b6ecc84 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.173004 Jul 14 16:08:16.012536 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 567/1135] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:15 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:17.010781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:17.011346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:17.018021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.018471 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.019238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.019663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:17.020120 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.020331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:17.026500 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.026950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.027711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.028190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.043087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-549c8b2a-316b-42ae-ac18-4c435a6e0373 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/ips" status: 200 len: 151 microversion: 2.1 time: 0.036663 Jul 14 16:08:17.043884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 569/1136] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:08:17 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:17.171314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.180685 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.182197 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.183375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da7a2965-761f-4999-8707-baa4807c2dfa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1813 microversion: 2.20 time: 0.167628 Jul 14 16:08:17.184341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 568/1137] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:18.201766 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:18.202378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:18.208942 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.209329 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.210096 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.210535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.341138 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.350524 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.352026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.353204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef16d4cb-3554-4c2d-ae5e-ff4105d1e104 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1800 microversion: 2.20 time: 0.155565 Jul 14 16:08:18.353760 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 570/1138] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:08:18 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:19.930474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fe7b4b8-a9aa-4bb7-beed-52de2885b703"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:19.931847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:19.938203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.938654 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.939422 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.941352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.834121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08a675a9-5a00-458e-b955-a800f2a2bf9a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "POST /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.908120 Jul 14 16:08:23.835012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 569/1139] 10.222.0.119 () {60 vars in 1327 bytes} [Thu Jul 14 16:08:19 2022] POST /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments => generated 194 bytes in 3910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:24.560081 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:24.561064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:24.567961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.568613 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.569472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.569984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.596387 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lazy-loading 'flavor' on Instance uuid 671e535d-0d05-4760-a181-1dba2d2c6a48 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:08:24.882138 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0ecb9fb9-2416-42a4-bb3e-b9fce0eb5e81 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "POST /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48/action" status: 202 len: 0 microversion: 2.1 time: 0.325836 Jul 14 16:08:24.885528 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 571/1140] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:08:24 2022] POST /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:08:24.896722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:24.898106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:24.907025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.907487 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.908289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.908869 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:25.052007 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:25.061107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf879b46-bc48-434d-a78d-47bf235eff15 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.170956 Jul 14 16:08:25.061803 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 570/1141] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:24 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:26.081169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:26.081985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:26.088571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.089152 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.090043 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.090832 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.246778 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.258027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c996cda-81eb-4aee-8247-3c039a3c83b3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.182585 Jul 14 16:08:26.258614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 572/1142] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:26 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:27.277831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.278388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.286326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.286769 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.287533 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.287961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.420873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.428629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5dc49450-2295-4df2-8de2-22aaf0998e0a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.154812 Jul 14 16:08:27.429214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 571/1143] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:27 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:28.447597 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:28.448194 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:28.454929 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.455399 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.456210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.456734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.599423 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.607496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dde5d402-b8f9-40d0-b268-6eda98ff163b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.165168 Jul 14 16:08:28.608064 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 573/1144] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:28 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:29.624253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:29.624871 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.627293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=24 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:29.631961 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.632554 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.633321 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.633759 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.771710 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.779940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-773be37d-a3e1-4e63-8bdf-a5f4da33c89b tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.159252 Jul 14 16:08:29.780638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 572/1145] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:29 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:30.797180 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:30.797785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:30.804590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.805038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.806956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.806956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.957239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.965360 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-19b0d7e5-ff0b-4f21-970c-03f20817001d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.172381 Jul 14 16:08:30.965784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 574/1146] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:30 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:31.048242 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-542610337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057527239", "security_groups": [{"name": "tempest-secgroup-smoke-695602955"}], "block_device_mapping_v2": [{"uuid": "6d21f639-31ab-4d73-8a90-493e431fab09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c436165-5659-4f64-9bb3-46eb0ae69617"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:31.174955 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] validate_networks() for [('7c436165-5659-4f64-9bb3-46eb0ae69617', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:08:31.601467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:08:31.601892 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:08:31.602364 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:08:31.602770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:08:31.603184 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:08:31.612804 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.613256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.614055 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.614491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.631619 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:08:31.635658 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Getting quotas for user 56191d451ddf4fba953c27dd79484723 and project 1207210005f34c4aabbe6966e469c1a0. Resources: {'ram', 'instances', 'cores'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:08:31.697623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:08:31.699887 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d21f639-31ab-4d73-8a90-493e431fab09',volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:08:31.984168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:31.984788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:31.991575 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.992238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.997403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.997403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.131675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.140496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0735c928-b73d-40a5-9939-2ec54880774a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.160596 Jul 14 16:08:32.141071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 575/1147] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:31 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:32.177715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc6ad82d-c2e2-41b2-804b-c90d65bcf2db tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.134141 Jul 14 16:08:32.184214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 573/1148] 10.222.0.119 () {60 vars in 1151 bytes} [Thu Jul 14 16:08:31 2022] POST /compute/v2.1/servers => generated 407 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 16:08:32.189969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2173bb2e-e713-405d-8a4d-93f3f1347b6f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:32.190664 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2173bb2e-e713-405d-8a4d-93f3f1347b6f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:32.253224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2173bb2e-e713-405d-8a4d-93f3f1347b6f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.262626 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2173bb2e-e713-405d-8a4d-93f3f1347b6f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1097 microversion: 2.1 time: 0.077247 Jul 14 16:08:32.266647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 576/1149] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:32 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:33.162981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.162981 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.168954 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.169404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.170170 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.170607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.281908 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.282661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.286985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=32 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:33.291199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.296669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.296669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.296669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.318040 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.327090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-255b71f5-a43f-43e8-84ac-e9a3bfbb5432 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.170123 Jul 14 16:08:33.368053 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 574/1150] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:33 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:33.368596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.368596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa857353-316f-4fca-82f2-11f45c1f0c92 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1147 microversion: 2.1 time: 0.085573 Jul 14 16:08:33.368596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 577/1151] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:33 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:33.673125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.673773 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.679868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.680336 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.681113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.681617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.764376 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'services' on Instance uuid 032f2924-d847-4f21-982a-720b0bfcf434 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:08:34.042356 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-58d61db6-415f-4ee5-a5f8-0bbf6ccf0249 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments/7fe7b4b8-a9aa-4bb7-beed-52de2885b703" status: 202 len: 0 microversion: 2.1 time: 0.374104 Jul 14 16:08:34.045559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 575/1152] 10.222.0.119 () {58 vars in 1420 bytes} [Thu Jul 14 16:08:33 2022] DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments/7fe7b4b8-a9aa-4bb7-beed-52de2885b703 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:34.053487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.054563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.065051 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.065533 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.066352 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.066977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.098207 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d931e9fb-fac6-4ba1-9fd9-df1ee89ec1a7 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 Jul 14 16:08:34.098781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 578/1153] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:34.345241 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.346068 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.353224 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.353745 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.354608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.355110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.380222 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.380838 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.387422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.387952 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.389238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.390111 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.471115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:34.483809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20fc8266-1bc1-4a04-b219-b9bbd9dcc857 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1195 microversion: 2.1 time: 0.107299 Jul 14 16:08:34.484522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 579/1154] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1195 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:34.536591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:34.546711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5e96e189-3a85-445b-b041-f68bc31ecb10 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.205970 Jul 14 16:08:34.547550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 576/1155] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:35.110725 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:35.111670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:35.119174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.119623 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.122033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.122033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.156783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c645b15-1609-43a0-8cca-99b1d768bba5 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050444 Jul 14 16:08:35.157738 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 580/1156] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:08:35 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:35.503957 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:35.504680 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:35.512398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.512962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.513909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.514345 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.565883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:35.566488 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:35.574910 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.577197 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.579156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.583556 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.586901 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.597831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff25acc0-6800-4e24-8101-f3b3845e4de3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1213 microversion: 2.1 time: 0.097617 Jul 14 16:08:35.598504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 577/1157] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:35 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:35.753818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.778111 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc3f1d9d-483c-4bc0-a8ed-559235506b39 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.217797 Jul 14 16:08:35.779897 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 581/1158] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:35 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:36.168694 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.170078 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.176698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.177233 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.178079 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.178514 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.217778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f2673228-3ae1-4e4c-8ff9-b1e6ed039928 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053037 Jul 14 16:08:36.218967 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 578/1159] 10.222.0.119 () {58 vars in 1306 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:08:36.565857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.566446 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.573892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.574348 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.578134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.578134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.612205 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:08:36.618318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.620286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.633823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.634346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.635405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.636017 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.774792 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:36.821201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.830446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc1e4862-101a-43c9-980e-d1631014348f tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1280 microversion: 2.1 time: 0.219476 Jul 14 16:08:36.831045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 579/1160] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:36.835752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.836576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.843277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.843738 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.844545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.844985 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.018722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.022568 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-22df8f7b-cd49-44cc-bcff-9684a74377d1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.190387 Jul 14 16:08:37.023180 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 580/1161] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:37.037505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1bbd4483-eb01-4a33-ae02-6ab51dc3cb6f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 204 len: 0 microversion: 2.1 time: 0.475440 Jul 14 16:08:37.038174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 582/1162] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:08:36 2022] DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:08:37.053983 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:37.054594 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:37.061399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.061950 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.062733 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.063189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.218614 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.227162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f65c2a3d-6352-499f-b4e8-7bf11030f231 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1686 microversion: 2.1 time: 0.176987 Jul 14 16:08:37.227754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 581/1163] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:37 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:37.276487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-add836e0-1464-4461-aa73-170e46326b09 req-95641594-8d95-4f75-b47e-70fa6207eb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7a606b-3d68-4e3b-aa83-850fad7ab0b2", "tag": "90554f6b-eff0-444e-8bc6-754f61980b63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:37.285172 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-add836e0-1464-4461-aa73-170e46326b09 req-95641594-8d95-4f75-b47e-70fa6207eb54 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.285695 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-add836e0-1464-4461-aa73-170e46326b09 req-95641594-8d95-4f75-b47e-70fa6207eb54 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.297960 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-add836e0-1464-4461-aa73-170e46326b09 req-95641594-8d95-4f75-b47e-70fa6207eb54 service nova] Creating event network-changed:90554f6b-eff0-444e-8bc6-754f61980b63 for instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 on hv-cinder-84986 Jul 14 16:08:37.302785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-add836e0-1464-4461-aa73-170e46326b09 req-95641594-8d95-4f75-b47e-70fa6207eb54 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193700 Jul 14 16:08:37.303384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 583/1164] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:37.848071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:37.848700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:37.855125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.855574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.856492 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.856929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.871843 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:37.991416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.998715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4a2e136a-f327-435c-9247-f35fa02cd0b4 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1280 microversion: 2.1 time: 0.154577 Jul 14 16:08:37.999277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 582/1165] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:37 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:38.041196 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:38.041901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:38.048606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.049663 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.050639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.051097 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.181030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.189414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-914a6163-08bd-42f3-bc9d-3c8a84d78012 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.152922 Jul 14 16:08:38.189919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 584/1166] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:38 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:38.245202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:38.245811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:38.252672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.253112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.253864 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.254294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.380782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.389010 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b200f3d-8e14-4f97-b08e-da58c21b9115 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1686 microversion: 2.1 time: 0.147164 Jul 14 16:08:38.389590 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 583/1167] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:38 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:39.015068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:39.015681 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.021824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.022285 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.023067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.023494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.173189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.180841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f74d0e73-041f-4dcb-ac55-ab243fdec3b8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.169969 Jul 14 16:08:39.181415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 585/1168] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:39 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:39.205994 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:39.206739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.213811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.214009 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.214976 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.215571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.348463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.356392 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c836adb-2eed-4239-9da2-0c3c3d44bf6c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.154288 Jul 14 16:08:39.356960 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 584/1169] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:39 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:39.526858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:39.527474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.534394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.534844 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.535614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.536050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.672496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.680226 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-def4e32e-9d09-46fb-853e-23ea47ce5102 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1686 microversion: 2.1 time: 0.278181 Jul 14 16:08:39.680797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 586/1170] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:39 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1686 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:40.198506 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.199112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.205353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.205800 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.206561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.207102 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.346385 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.355413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-537189c8-4974-4090-b9d7-0b00d283eadc tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.160715 Jul 14 16:08:40.356061 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 585/1171] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:40.374563 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.375185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.393220 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.393711 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.394513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.394954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.627779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.639652 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf6d15a0-1dfa-4ada-8a7d-e6efc7fdbac5 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.268922 Jul 14 16:08:40.641676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 587/1172] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:40.699811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.701015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.710176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.711284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.712405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.713035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.783805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.791603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b0fe35e3-f47a-4981-b552-c6e50e174e97 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1619 microversion: 2.1 time: 0.096913 Jul 14 16:08:40.796668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 586/1173] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:41.046708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e008d507-3549-4729-8977-7804edf5148f req-dbc6f01b-d787-4317-9417-6f3af83c6ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032f2924-d847-4f21-982a-720b0bfcf434", "name": "network-vif-deleted", "tag": "53d09391-9464-4b81-9f45-3bb32e261a43"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:41.055380 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e008d507-3549-4729-8977-7804edf5148f req-dbc6f01b-d787-4317-9417-6f3af83c6ffe service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.057507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e008d507-3549-4729-8977-7804edf5148f req-dbc6f01b-d787-4317-9417-6f3af83c6ffe service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.068668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e008d507-3549-4729-8977-7804edf5148f req-dbc6f01b-d787-4317-9417-6f3af83c6ffe service nova] Creating event network-vif-deleted:53d09391-9464-4b81-9f45-3bb32e261a43 for instance 032f2924-d847-4f21-982a-720b0bfcf434 on hv-cinder-84986 Jul 14 16:08:41.074165 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e008d507-3549-4729-8977-7804edf5148f req-dbc6f01b-d787-4317-9417-6f3af83c6ffe service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Jul 14 16:08:41.074769 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 588/1174] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:41.376669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.379823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.384802 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.385518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.386299 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.386726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.537953 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.547206 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-186ece7d-c541-487f-a25f-8c079973fab6 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.171386 Jul 14 16:08:41.551692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 587/1175] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:41.658886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.659615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.666336 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.669641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.669641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.669641 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.810920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.812494 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.815584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:41.816554 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:41.823640 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.830238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.830238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.830238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.929579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.934548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.939290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0fc2e899-c83c-4f31-95ba-6984c9a2887b tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1330 microversion: 2.1 time: 0.134144 Jul 14 16:08:41.940260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 588/1176] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:41.953301 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f376280c-2744-4955-89ff-5e87aa0eea3f tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.299228 Jul 14 16:08:41.963791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 589/1177] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:42.560331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.561521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.568062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.568541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.569314 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.569746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.699629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.707355 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6184ea8d-4838-4414-b173-a420bb077aae tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.151409 Jul 14 16:08:42.707924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 589/1178] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:42.955943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.956579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.958596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:42.963914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.964424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.965311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.965892 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.971470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.972085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.978187 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.978630 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.979403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.979833 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.998148 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.998747 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.999746 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'fault' on Instance uuid 032f2924-d847-4f21-982a-720b0bfcf434 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:08:43.052057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.068019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-765389ea-e0b4-4f9a-80ed-303e79746943 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1335 microversion: 2.1 time: 0.115987 Jul 14 16:08:43.068654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 590/1179] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:43.137092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.145237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ebcbc3af-351b-4ea3-a5c2-ffb579b66329 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.179020 Jul 14 16:08:43.145811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 590/1180] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:43.724954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:43.725567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:43.732149 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.732612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.733884 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.734540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.866656 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.875374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8e64f13-2d4a-4ff3-b477-b5b035ff4cf7 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.153516 Jul 14 16:08:43.875951 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 591/1181] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:43 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:44.086041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.086688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.094201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.096159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.096159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.096159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.127481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.127933 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.128407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lazy-loading 'fault' on Instance uuid 032f2924-d847-4f21-982a-720b0bfcf434 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:08:44.163407 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.164381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.172012 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.172485 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.173512 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.174202 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.177717 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d02887422a43e4bb69566a2d64e890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4941c3a4d1be445b972c8684bc8b18d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:44.187828 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-216924a0-2dbc-4eb2-b89c-fbe3191b698e tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 200 len: 1335 microversion: 2.1 time: 0.104648 Jul 14 16:08:44.188726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 591/1182] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:44.311176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:44.319347 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f0b5ded-45cc-4434-9840-27ca5799a414 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.160313 Jul 14 16:08:44.319918 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 592/1183] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:44.892616 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.893255 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.899281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.899729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.900552 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.900962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.041327 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.049137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55a11893-1dfc-4ab2-9a44-9e0653ef800e tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.161018 Jul 14 16:08:45.050331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 592/1184] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:45.205878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.207071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:45.213748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.214210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.214954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.215384 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.229493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 HTTP/1.1 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:45.231132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:45.237654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '032f2924-d847-4f21-982a-720b0bfcf434'} Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:45.238637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:45.240236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:45.241662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:45.241662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-13204444-ac4a-455c-8a9f-0cd85ac75161 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 404 len: 111 microversion: 2.1 time: 0.031423 Jul 14 16:08:45.241662 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 593/1185] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:45 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:45.247110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f49c090-29c3-43f9-93e9-6e41e6eaa493 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '.version_select at 0x7f0dc1f129d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.317891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f49c090-29c3-43f9-93e9-6e41e6eaa493 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188541934" status: 202 len: 0 microversion: 2.1 time: 0.074586 Jul 14 16:08:45.318481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 593/1186] 10.222.0.119 () {58 vars in 1222 bytes} [Thu Jul 14 16:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188541934 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:45.337870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.339178 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:45.346883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.347554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.348300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.349210 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.513924 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.523486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6c172f47-2de6-415c-9fcd-90cefd12ab20 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.189743 Jul 14 16:08:45.528367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 594/1187] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:45 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:46.066288 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:46.066909 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.075189 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.075652 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.076476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.076913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.234831 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.242621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13bf34ef-382f-4dec-9664-7e8afd8cadf0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.180793 Jul 14 16:08:46.243366 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 594/1188] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:46 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:46.540373 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:46.541072 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.548235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.548863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.550394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.550394 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.684436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.692811 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-692479f7-2d2f-479f-9565-290c77199c89 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1513 microversion: 2.1 time: 0.156353 Jul 14 16:08:46.693377 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 595/1189] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:46 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:46.715795 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:46.716388 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.723163 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.723645 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.724448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.724882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.975567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-beee51a5-c2c1-4041-a74a-735fd938c240 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "POST /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48/action" status: 202 len: 0 microversion: 2.1 time: 0.263564 Jul 14 16:08:46.981405 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 595/1190] 10.222.0.119 () {60 vars in 1282 bytes} [Thu Jul 14 16:08:46 2022] POST /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:46.988945 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:46.989705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.995805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.996290 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.997059 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.997490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.178675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.186566 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c11b95ec-dc08-4002-ab62-c917365b6100 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1521 microversion: 2.1 time: 0.201458 Jul 14 16:08:47.187424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 596/1191] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:46 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:47.260847 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.261552 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.269832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.269832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.270214 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.270655 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.423486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.433551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02e28d98-6c40-4e7b-82d1-bbaedc7de780 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.174176 Jul 14 16:08:47.433551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 596/1192] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:47 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:47.476789 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.477362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.483312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.483731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.484776 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.485213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.499358 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 HTTP/1.1 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:47.500966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.502614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '032f2924-d847-4f21-982a-720b0bfcf434'} Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:47.503645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.505422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.511311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:47.511311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7039d1c-1aaa-4154-a657-7424e7e46c64 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 404 len: 111 microversion: 2.1 time: 0.029685 Jul 14 16:08:47.511311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 597/1193] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:08:47 2022] DELETE /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:47.512875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.513597 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 032f2924-d847-4f21-982a-720b0bfcf434] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.521082 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.521608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.522462 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.522975 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.538151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 HTTP/1.1 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:08:47.540021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.541718 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '032f2924-d847-4f21-982a-720b0bfcf434'} Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:47.542641 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. Jul 14 16:08:47.544190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:47.548931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 032f2924-d847-4f21-982a-720b0bfcf434 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:47.548931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-06975682-29c0-437f-afff-006413c80b1c tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434" status: 404 len: 111 microversion: 2.1 time: 0.034659 Jul 14 16:08:47.548931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 597/1194] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:47 2022] GET /compute/v2.1/servers/032f2924-d847-4f21-982a-720b0bfcf434 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:08:48.205334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.206580 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.212812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.213265 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.214040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.214483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.354236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.362665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b58c0cb6-4429-402f-8919-17080be5ffc1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1521 microversion: 2.1 time: 0.162117 Jul 14 16:08:48.363241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 598/1195] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:48.448333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.448949 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.455667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.456162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.457055 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.457489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.610275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.618761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fe3896af-9962-4d72-a697-d14516f0bed9 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.174328 Jul 14 16:08:48.620747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 598/1196] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:48.950572 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.951399 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.962002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.962749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.979192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.979192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.979612 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 HTTP/1.1 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:48.981215 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:48.982607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'd297bd53-1291-4d7e-ac92-6bb50b22a623'} Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:48.984005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:48.985794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:48.989693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:48.989693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ecdcab80-1ed2-4063-9b05-b17899d53b98 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 404 len: 111 microversion: 2.1 time: 0.037168 Jul 14 16:08:48.989693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 599/1197] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:08:48 2022] DELETE /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:48.992810 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.993198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: d297bd53-1291-4d7e-ac92-6bb50b22a623] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.999460 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.999918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.000734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.001353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.016601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 HTTP/1.1 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:08:49.018174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:49.019819 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'd297bd53-1291-4d7e-ac92-6bb50b22a623'} Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:49.020711 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. Jul 14 16:08:49.022219 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.024726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance d297bd53-1291-4d7e-ac92-6bb50b22a623 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:49.025585 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-be59825b-6d49-4c30-a337-c3257c1b3c0a tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623" status: 404 len: 111 microversion: 2.1 time: 0.037145 Jul 14 16:08:49.026146 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 599/1198] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/d297bd53-1291-4d7e-ac92-6bb50b22a623 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:08:49.035630 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.036461 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.042456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.043121 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.044080 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.044743 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.047967 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-67d386a0-37cb-44c0-873b-297e784a6991 req-b3add77d-c4c4-43c8-9222-22a343a85756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "name": "network-vif-unplugged", "status": "completed", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:49.056085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-67d386a0-37cb-44c0-873b-297e784a6991 req-b3add77d-c4c4-43c8-9222-22a343a85756 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.056564 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-67d386a0-37cb-44c0-873b-297e784a6991 req-b3add77d-c4c4-43c8-9222-22a343a85756 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.059607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:49.060614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da HTTP/1.1 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:49.062224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.068505 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '049a39c1-4f3d-4d0b-9363-90141a78f8da'} Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:49.069538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.070827 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.072665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:49.072665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8461f25f-9e90-488d-b391-1784f3b8bb46 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 404 len: 111 microversion: 2.1 time: 0.032199 Jul 14 16:08:49.072665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 600/1199] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:08:49 2022] DELETE /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:49.073123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.compute.server_external_events [req-67d386a0-37cb-44c0-873b-297e784a6991 req-b3add77d-c4c4-43c8-9222-22a343a85756 service nova] Unable to find a host for instance 671e535d-0d05-4760-a181-1dba2d2c6a48. Dropping event network-vif-unplugged {{(pid=125267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 16:08:49.073123 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-67d386a0-37cb-44c0-873b-297e784a6991 req-b3add77d-c4c4-43c8-9222-22a343a85756 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028379 Jul 14 16:08:49.074382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 600/1200] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 16:08:49.074522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.075131 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 049a39c1-4f3d-4d0b-9363-90141a78f8da] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.082374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.082820 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.084666 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.085109 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.104325 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da HTTP/1.1 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:49.105895 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.107300 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '049a39c1-4f3d-4d0b-9363-90141a78f8da'} Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:49.108191 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. Jul 14 16:08:49.110144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:49.111611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 049a39c1-4f3d-4d0b-9363-90141a78f8da could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:49.111611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c0e1329-0253-4be5-ab90-aa448fb4444f tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da" status: 404 len: 111 microversion: 2.1 time: 0.038716 Jul 14 16:08:49.111611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 601/1201] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/049a39c1-4f3d-4d0b-9363-90141a78f8da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:49.380617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.381263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.388069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.388691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.390311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.390669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.636374 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.637000 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.644746 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.645499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.646367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.646809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.850935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.859591 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-700d4ad0-b0eb-494d-91ea-2fa050391146 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1523 microversion: 2.1 time: 0.482958 Jul 14 16:08:49.860890 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 601/1202] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:49.897866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.906033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0185bbed-13d5-4854-8ae9-98214d75c16d tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.273785 Jul 14 16:08:49.909113 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 602/1203] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:50.603090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.604069 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.612174 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.612993 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.614385 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.615431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.632165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 HTTP/1.1 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:08:50.633631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.641600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '41756c6f-5714-4b75-b3fb-ee75edcac924'} Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:50.642903 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.644509 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.646030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:50.646030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6042a8cc-9893-49cd-bb24-6cb53f51efb8 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 404 len: 111 microversion: 2.1 time: 0.037192 Jul 14 16:08:50.646030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 602/1204] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:08:50 2022] DELETE /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:50.651040 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.651567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] [instance: 41756c6f-5714-4b75-b3fb-ee75edcac924] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.662834 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.663288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.664057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.664518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.679634 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] HTTP exception thrown: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Request method failure captured: Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 HTTP/1.1 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0DyvQQY8oy9WocYO5Rcb_uZJ_RFqyl2CczPigHxOF-giS__slS-nTY363k-vi7JmwkTTeT-i25k4YzDAPq8tTgXSjXTh45w0U4lfDVQiBNSd5G4bJvA2-dXRRyXn9ZzAiDz8K28xhO0T20LldgCgnSkRsqwn5Ivbr8CXldH_yh8KzpQ Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:08:50.681262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/4941c3a4d1be445b972c8684bc8b18d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_4941c3a4d1be445b972c8684bc8b18d0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/4941c3a4d1be445b972c8684bc8b18d0"}]}] Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 4941c3a4d1be445b972c8684bc8b18d0 Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-968347235 Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: b0d02887422a43e4bb69566a2d64e890 Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-968347235-project Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.682638 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '41756c6f-5714-4b75-b3fb-ee75edcac924'} Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:50.683424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. Jul 14 16:08:50.684748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:08:50.687567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] Returning 404 to user: Instance 41756c6f-5714-4b75-b3fb-ee75edcac924 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:50.687567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-146a9328-5d13-4915-8632-141a18e56e05 tempest-AttachVolumeNegativeTest-968347235 tempest-AttachVolumeNegativeTest-968347235-project] 10.222.0.119 "GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924" status: 404 len: 111 microversion: 2.1 time: 0.036358 Jul 14 16:08:50.687567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 603/1205] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/41756c6f-5714-4b75-b3fb-ee75edcac924 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:50.906469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.906469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.906469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.906469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.907931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.907931 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.925174 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.926073 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.935454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.935901 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.937608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.938486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.943482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:51.346549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.351289 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.361302 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e51ba6e0-e6de-4b2d-abcb-7482ca2807a5 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.440519 Jul 14 16:08:51.362818 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 604/1206] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:51.373615 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b0886501-7f69-494d-b856-ebe96fd34712 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.499419 Jul 14 16:08:51.380086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 603/1207] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:51.416282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-fad6b046-0063-45ff-a9d3-ae06bc9f3e9c req-25831600-4b7a-4b1f-b163-20d54afbf258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7a606b-3d68-4e3b-aa83-850fad7ab0b2", "name": "network-vif-plugged", "status": "completed", "tag": "90554f6b-eff0-444e-8bc6-754f61980b63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:51.425661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-fad6b046-0063-45ff-a9d3-ae06bc9f3e9c req-25831600-4b7a-4b1f-b163-20d54afbf258 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:51.426462 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-fad6b046-0063-45ff-a9d3-ae06bc9f3e9c req-25831600-4b7a-4b1f-b163-20d54afbf258 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:51.439764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-fad6b046-0063-45ff-a9d3-ae06bc9f3e9c req-25831600-4b7a-4b1f-b163-20d54afbf258 service nova] Creating event network-vif-plugged:90554f6b-eff0-444e-8bc6-754f61980b63 for instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 on hv-cinder-84986 Jul 14 16:08:51.451518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-fad6b046-0063-45ff-a9d3-ae06bc9f3e9c req-25831600-4b7a-4b1f-b163-20d54afbf258 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032918 Jul 14 16:08:51.451518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 605/1208] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:52.389125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:52.391052 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:52.403162 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:52.404154 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:52.416467 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.417744 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.418209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.419489 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.421290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.421852 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.422403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.422754 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.750574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.757228 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.760434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c2b1c40-98a4-4201-babb-d4fb485e2461 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.361215 Jul 14 16:08:52.761731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 606/1209] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:52 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:52.773550 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9f73ce52-f168-4dba-9ed8-9b2d369195d0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.389163 Jul 14 16:08:52.774402 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 604/1210] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:52 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:53.777577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:53.778858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:53.791120 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:53.792393 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:53.800953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.803404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.803861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.804574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.805557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.806938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.807381 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.808573 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.120581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.120581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d967421-5dbd-46fc-a2e1-2b57ef9c28c3 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.342415 Jul 14 16:08:54.120581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 607/1211] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:53 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:54.133568 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.141918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6158c26-136a-4e44-8ed6-32c161ba3b30 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1268 microversion: 2.1 time: 0.355037 Jul 14 16:08:54.142519 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 605/1212] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:53 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1268 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:55.134395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:55.135133 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:55.142085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.142615 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.143500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.143954 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.164213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:55.165524 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:55.175004 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.177986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.179158 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.180316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.381046 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:55.389291 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62030efd-d562-4444-b377-a08bd7aac208 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.258690 Jul 14 16:08:55.399953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 608/1213] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:55 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:55.400566 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:55.414861 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-86549e7e-b276-4e45-af2a-77ed0ef9eabd tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1455 microversion: 2.1 time: 0.254682 Jul 14 16:08:55.426986 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 606/1214] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:55 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1455 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:55.434123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:55.435345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:55.446091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.446091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.446091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.446091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.677321 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:55.683365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0a66c29-08ff-4c31-babb-af26d74c6764 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1455 microversion: 2.1 time: 0.253139 Jul 14 16:08:55.683948 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 609/1215] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:55 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1455 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:56.407371 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:56.407996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:56.414768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.415433 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.416298 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.416746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.598764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:56.611112 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-671ea079-9737-42e3-aa8f-a481df50e582 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.208128 Jul 14 16:08:56.613436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 607/1216] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:56 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:57.630330 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:57.631693 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:57.638582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.639480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:57.641264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.641863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:57.802715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:57.820018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a3901b97-15d6-4450-a0b2-3fbda3397987 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.193691 Jul 14 16:08:57.820633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 610/1217] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:57 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:57.986651 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-eb3dbd80-6168-4c6c-bfa4-4a7415914a9d req-dfeb1fea-4484-434e-add1-1da9db19794f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7a606b-3d68-4e3b-aa83-850fad7ab0b2", "tag": "90554f6b-eff0-444e-8bc6-754f61980b63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:57.996846 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eb3dbd80-6168-4c6c-bfa4-4a7415914a9d req-dfeb1fea-4484-434e-add1-1da9db19794f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.997426 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eb3dbd80-6168-4c6c-bfa4-4a7415914a9d req-dfeb1fea-4484-434e-add1-1da9db19794f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:58.009796 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a0c39eb2-eeb2-4246-bc53-e5ff3bb1aa41 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Action: 'create', calling method: .version_select at 0x7f0dc1f331f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1330319404"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:58.011525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-eb3dbd80-6168-4c6c-bfa4-4a7415914a9d req-dfeb1fea-4484-434e-add1-1da9db19794f service nova] Creating event network-changed:90554f6b-eff0-444e-8bc6-754f61980b63 for instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 on hv-cinder-84986 Jul 14 16:08:58.017390 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-eb3dbd80-6168-4c6c-bfa4-4a7415914a9d req-dfeb1fea-4484-434e-add1-1da9db19794f service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 Jul 14 16:08:58.018289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 611/1218] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:58.723628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a0c39eb2-eeb2-4246-bc53-e5ff3bb1aa41 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.851298 Jul 14 16:08:58.724288 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 608/1219] 10.222.0.119 () {60 vars in 1159 bytes} [Thu Jul 14 16:08:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 853 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 14 16:08:58.737038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4b4425d5-02a0-4642-9fec-44cd7b147e50 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f92700>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:58.796027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4b4425d5-02a0-4642-9fec-44cd7b147e50 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 200 len: 345 microversion: 2.1 time: 0.063921 Jul 14 16:08:58.796903 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 612/1220] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:58 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:58.837025 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:58.838117 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:58.845647 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:58.846218 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:58.847012 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:58.847647 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:59.000892 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:59.009130 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0fca03d-3c70-4ab8-af2c-03688cfca92a tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.176031 Jul 14 16:08:59.009805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 609/1221] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:08:58 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:59.809535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-81c9dbd5-b52b-48bf-9cf9-140d1c816f0e tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1e014c0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:59.858211 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-81c9dbd5-b52b-48bf-9cf9-140d1c816f0e tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 200 len: 345 microversion: 2.1 time: 0.053001 Jul 14 16:08:59.863878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 613/1222] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:08:59 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:00.026770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:00.027446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:00.029736 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:00.035440 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.035904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.036704 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.037145 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.186375 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:00.194689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-33539fd9-06d8-4bf0-ba40-ce8a44633a90 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.171965 Jul 14 16:09:00.195284 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 610/1223] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:00 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:00.871054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef9e8ced-4946-440c-8b11-c94f8c0f370e tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc66664c0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:00.919614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef9e8ced-4946-440c-8b11-c94f8c0f370e tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 200 len: 346 microversion: 2.1 time: 0.052821 Jul 14 16:09:00.920228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 614/1224] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:09:00 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:00.938848 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8e1a23b-1ce2-4d77-944c-78324a873431 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Action: 'create', calling method: .version_select at 0x7f0dc1d0ea60>, body: {"snapshot": {"volume_id": "5db2c780-b163-4736-b8c6-3093c1fc740b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1035740145"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:01.212800 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.213535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:01.221143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.221598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.222369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.222809 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.361466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8e1a23b-1ce2-4d77-944c-78324a873431 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.433640 Jul 14 16:09:01.364730 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.367424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 611/1225] 10.222.0.119 () {60 vars in 1166 bytes} [Thu Jul 14 16:09:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:01.374011 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06b7639b-b335-4d17-9721-62da3d3c5284 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1ea20d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.374784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc5936c2-dffd-452f-a4ed-7db99c5413a1 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.163906 Jul 14 16:09:01.374784 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 615/1226] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:01.404542 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-06b7639b-b335-4d17-9721-62da3d3c5284 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.035764 Jul 14 16:09:01.405125 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 612/1227] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:01.414937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f328c6f-4a8d-4528-80b3-9ca235ff052a tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc20a9f70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.447398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f328c6f-4a8d-4528-80b3-9ca235ff052a tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034000 Jul 14 16:09:01.447398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 616/1228] 10.222.0.119 () {58 vars in 1144 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:01.456760 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a23fdc6b-fdb1-4cb0-9b70-fa0a3238390b tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1e49940>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.486917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a23fdc6b-fdb1-4cb0-9b70-fa0a3238390b tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.034745 Jul 14 16:09:01.487497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 613/1229] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:09:02.390977 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:02.391569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:02.398250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.398694 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.399477 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.400070 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.498830 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8051035-6233-4172-9268-1133e94e09c6 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1ef7310>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:02.529057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8051035-6233-4172-9268-1133e94e09c6 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.034522 Jul 14 16:09:02.529629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 614/1230] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:02 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:09:02.534800 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.542549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d1450d0-e1e3-4da6-ae2b-1980404083bb tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.156538 Jul 14 16:09:02.543154 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 617/1231] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:02 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:03.541346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ec824f4e-7e9b-45f5-84f8-6b69d266dd3f tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc2117670>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:03.558726 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:03.559407 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:03.566955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.567402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.568256 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.568692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.572252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ec824f4e-7e9b-45f5-84f8-6b69d266dd3f tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.035169 Jul 14 16:09:03.580041 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 615/1232] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:03 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:03.710087 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:03.719279 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e185887-96ab-433b-b0ef-6a7f6d535a1e tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.164452 Jul 14 16:09:03.719856 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 618/1233] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:03 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:04.588252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f2ac045b-89fd-47b3-bd68-853a7982b119 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f609d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:04.617741 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f2ac045b-89fd-47b3-bd68-853a7982b119 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.036547 Jul 14 16:09:04.618343 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 616/1234] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:04 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:04.737118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:04.737734 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:04.740219 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:04.744994 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.745448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.746214 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.746650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.885867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:04.893462 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-462cb07c-010b-418e-a3b5-ef9353a00905 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.161043 Jul 14 16:09:04.894027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 619/1235] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:04 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:05.630844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c53f50c3-c852-4398-b785-2d63bf04c6eb tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f60310>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:05.661143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c53f50c3-c852-4398-b785-2d63bf04c6eb tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.034566 Jul 14 16:09:05.661746 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 617/1236] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:05 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:05.911026 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:05.911645 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:05.918365 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.918815 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:05.919579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.920015 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.052261 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.059721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6cdab1d-d49e-4629-a847-bfb897f28cc8 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.152674 Jul 14 16:09:06.060311 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 620/1237] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:05 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:06.674529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-236f381f-6561-4a42-a066-8d103103f689 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1ef7d30>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:06.704768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-236f381f-6561-4a42-a066-8d103103f689 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.035920 Jul 14 16:09:06.705407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 618/1238] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:06 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:07.075981 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:07.076567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:07.083928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.084424 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.085198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.085640 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.221050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.228606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20c59ccb-4e33-452c-9004-341c99e005ee tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.156557 Jul 14 16:09:07.229183 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 621/1239] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:07 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:07.717209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d518c3cb-f80a-4593-abbe-b0e8b53d0616 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc21a2b80>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:07.748391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d518c3cb-f80a-4593-abbe-b0e8b53d0616 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.035405 Jul 14 16:09:07.748962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 619/1240] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:07 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:08.246956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.247594 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:08.254666 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.255117 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.255887 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.256349 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.391465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.399058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cad47034-f16f-493e-a728-ef3d8329f7e4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.155975 Jul 14 16:09:08.399578 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 622/1241] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:08.762328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4adc0ec8-0de8-4e3c-bb65-d3e8e56292d9 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1d5a8b0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.793900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4adc0ec8-0de8-4e3c-bb65-d3e8e56292d9 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 288 microversion: 2.1 time: 0.034017 Jul 14 16:09:08.793900 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 620/1242] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:08.803751 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69d4b701-058a-435c-a746-b6d803e737d6 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1c96f70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.930053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69d4b701-058a-435c-a746-b6d803e737d6 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "DELETE /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 202 len: 0 microversion: 2.1 time: 0.130076 Jul 14 16:09:08.930858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 623/1243] 10.222.0.119 () {58 vars in 1258 bytes} [Thu Jul 14 16:09:08 2022] DELETE /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:09:08.939320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-290569e5-0702-4042-b885-4eec28ca07dd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc2161c10>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.969689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-290569e5-0702-4042-b885-4eec28ca07dd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 200 len: 287 microversion: 2.1 time: 0.034395 Jul 14 16:09:08.970287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 621/1244] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:09.241750 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-4699aa1c-50e0-46ab-8936-f670375ae605 req-df9b8f9a-046c-465a-8ce0-84c40af22c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "name": "network-vif-plugged", "status": "completed", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:09.250317 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-4699aa1c-50e0-46ab-8936-f670375ae605 req-df9b8f9a-046c-465a-8ce0-84c40af22c4b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.250926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-4699aa1c-50e0-46ab-8936-f670375ae605 req-df9b8f9a-046c-465a-8ce0-84c40af22c4b service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.262409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-4699aa1c-50e0-46ab-8936-f670375ae605 req-df9b8f9a-046c-465a-8ce0-84c40af22c4b service nova] Creating event network-vif-plugged:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:09:09.267943 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-4699aa1c-50e0-46ab-8936-f670375ae605 req-df9b8f9a-046c-465a-8ce0-84c40af22c4b service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 Jul 14 16:09:09.268574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 624/1245] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:09.416544 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:09.417151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:09.424276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.424722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.425490 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.425918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.564342 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.573838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ffffbc1-527e-4a29-aaf3-3fa96cebf565 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.161082 Jul 14 16:09:09.574433 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 622/1246] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:09 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:09.982255 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-32414bd5-6ae5-4575-8bef-d79a580192bd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f92f70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.007924 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-32414bd5-6ae5-4575-8bef-d79a580192bd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] HTTP exception thrown: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-32414bd5-6ae5-4575-8bef-d79a580192bd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Request method failure captured: Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea HTTP/1.1 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D-Z2hgY7bmCyEIpP5OBdycSs7H6VyVJEXm1PzfD6oNbnSzSN5YRvJoQWaXAOxOU5s9JoBb5uLo0JK41PjPzt5ovtL4B5xWlnE8EJmBr6i9swLLdz6w4YNxn1iICrqZtOk1JQobRuQxCBbJtnSGB4zWk0f4yISIlDMblkkxEYh0oX-c Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:09:10.013509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cc7a96296b9f4a8b90a33dae99521c99", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}] Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: aba6d6e3a5e34f53bc0b274f806984f6 Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'afd37e47-d26c-4af2-a465-916c1a4840ea'} Jul 14 16:09:10.015146 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. (HTTP 404) (Request-ID: req-09d29f09-6310-46dd-a35b-b2fb07406763) Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.016274 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:10.017731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 16:09:10.019181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-32414bd5-6ae5-4575-8bef-d79a580192bd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Returning 404 to user: Snapshot afd37e47-d26c-4af2-a465-916c1a4840ea could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:09:10.020828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-32414bd5-6ae5-4575-8bef-d79a580192bd tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea" status: 404 len: 111 microversion: 2.1 time: 0.033785 Jul 14 16:09:10.021849 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 625/1247] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:09:09 2022] GET /compute/v2.1/os-snapshots/afd37e47-d26c-4af2-a465-916c1a4840ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:09:10.021942 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bc48f94b-483a-46bf-a13f-eaba0a221472 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f600d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.265560 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bc48f94b-483a-46bf-a13f-eaba0a221472 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 202 len: 0 microversion: 2.1 time: 0.248217 Jul 14 16:09:10.266133 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 623/1248] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:09:10 2022] DELETE /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:09:10.279164 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba9580da-aaad-46e2-b946-d85680d74912 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc666fb80>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.333254 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba9580da-aaad-46e2-b946-d85680d74912 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 200 len: 345 microversion: 2.1 time: 0.058259 Jul 14 16:09:10.333947 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 626/1249] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:09:10 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:10.590686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.591291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:10.598708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.599165 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.599920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.600445 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.753752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:10.761354 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e54434c4-4bf1-42ed-89d9-97e0b045fbe2 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.174497 Jul 14 16:09:10.761924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 624/1250] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:10 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:11.347375 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9fcff4e1-970d-4797-8f2a-0cbfc71ec830 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1e01310>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.375791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-9fcff4e1-970d-4797-8f2a-0cbfc71ec830 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] HTTP exception thrown: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9fcff4e1-970d-4797-8f2a-0cbfc71ec830 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Request method failure captured: Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b HTTP/1.1 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D-Z2hgY7bmCyEIpP5OBdycSs7H6VyVJEXm1PzfD6oNbnSzSN5YRvJoQWaXAOxOU5s9JoBb5uLo0JK41PjPzt5ovtL4B5xWlnE8EJmBr6i9swLLdz6w4YNxn1iICrqZtOk1JQobRuQxCBbJtnSGB4zWk0f4yISIlDMblkkxEYh0oX-c Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:09:11.377953 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cc7a96296b9f4a8b90a33dae99521c99", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}] Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: aba6d6e3a5e34f53bc0b274f806984f6 Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '5db2c780-b163-4736-b8c6-3093c1fc740b'} Jul 14 16:09:11.379727 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. (HTTP 404) (Request-ID: req-b352b644-1324-4bc5-b56e-750161c38980) Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.380814 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:11.382340 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:09:11.383831 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9fcff4e1-970d-4797-8f2a-0cbfc71ec830 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Returning 404 to user: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9fcff4e1-970d-4797-8f2a-0cbfc71ec830 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 404 len: 109 microversion: 2.1 time: 0.037318 Jul 14 16:09:11.385395 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 627/1251] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:09:11 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:09:11.394822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bff62bfb-7d69-4579-8659-f917218d5e00 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc1f23550>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.422875 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-bff62bfb-7d69-4579-8659-f917218d5e00 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] HTTP exception thrown: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bff62bfb-7d69-4579-8659-f917218d5e00 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Request method failure captured: Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b HTTP/1.1 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D-Z2hgY7bmCyEIpP5OBdycSs7H6VyVJEXm1PzfD6oNbnSzSN5YRvJoQWaXAOxOU5s9JoBb5uLo0JK41PjPzt5ovtL4B5xWlnE8EJmBr6i9swLLdz6w4YNxn1iICrqZtOk1JQobRuQxCBbJtnSGB4zWk0f4yISIlDMblkkxEYh0oX-c Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:09:11.425134 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cc7a96296b9f4a8b90a33dae99521c99", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}] Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: aba6d6e3a5e34f53bc0b274f806984f6 Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '5db2c780-b163-4736-b8c6-3093c1fc740b'} Jul 14 16:09:11.426774 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. (HTTP 404) (Request-ID: req-190d1977-b437-4888-be92-b388958d3dc3) Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.427935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:09:11.429389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 16:09:11.431190 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bff62bfb-7d69-4579-8659-f917218d5e00 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Returning 404 to user: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:09:11.432604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bff62bfb-7d69-4579-8659-f917218d5e00 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "DELETE /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 404 len: 109 microversion: 2.1 time: 0.036518 Jul 14 16:09:11.435749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 625/1252] 10.222.0.119 () {58 vars in 1252 bytes} [Thu Jul 14 16:09:11 2022] DELETE /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:09:11.437824 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9051694b-3e6e-4d89-a37e-5986f85ee846 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Calling method '.version_select at 0x7f0dc66665e0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.468234 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-9051694b-3e6e-4d89-a37e-5986f85ee846 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] HTTP exception thrown: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9051694b-3e6e-4d89-a37e-5986f85ee846 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Request method failure captured: Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b HTTP/1.1 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D-Z2hgY7bmCyEIpP5OBdycSs7H6VyVJEXm1PzfD6oNbnSzSN5YRvJoQWaXAOxOU5s9JoBb5uLo0JK41PjPzt5ovtL4B5xWlnE8EJmBr6i9swLLdz6w4YNxn1iICrqZtOk1JQobRuQxCBbJtnSGB4zWk0f4yISIlDMblkkxEYh0oX-c Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:09:11.470540 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/cc7a96296b9f4a8b90a33dae99521c99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_cc7a96296b9f4a8b90a33dae99521c99", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/cc7a96296b9f4a8b90a33dae99521c99"}]}] Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: cc7a96296b9f4a8b90a33dae99521c99 Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344324546 Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: aba6d6e3a5e34f53bc0b274f806984f6 Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344324546-project Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '5db2c780-b163-4736-b8c6-3093c1fc740b'} Jul 14 16:09:11.472713 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. (HTTP 404) (Request-ID: req-d642ab98-2afc-48e7-9afb-a1be457a4d9c) Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.473650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:09:11.474955 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:09:11.476408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9051694b-3e6e-4d89-a37e-5986f85ee846 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] Returning 404 to user: Volume 5db2c780-b163-4736-b8c6-3093c1fc740b could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9051694b-3e6e-4d89-a37e-5986f85ee846 tempest-VolumesSnapshotsTestJSON-1344324546 tempest-VolumesSnapshotsTestJSON-1344324546-project] 10.222.0.119 "GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b" status: 404 len: 109 microversion: 2.1 time: 0.040674 Jul 14 16:09:11.477783 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 628/1253] 10.222.0.119 () {58 vars in 1249 bytes} [Thu Jul 14 16:09:11 2022] GET /compute/v2.1/os-volumes/5db2c780-b163-4736-b8c6-3093c1fc740b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:09:11.779755 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.780172 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:11.788210 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.788668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:11.789661 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.790105 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:11.930238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:11.940761 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37b53dee-344c-46d1-a746-b9c708d9b15d tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1579 microversion: 2.1 time: 0.164785 Jul 14 16:09:11.941358 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 626/1254] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:11 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:12.958669 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:12.960569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:12.965858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.966353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.967115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.967546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.115940 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.123625 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7012d2b3-4e9d-483e-afa9-9d5e5e0ee807 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1566 microversion: 2.1 time: 0.169871 Jul 14 16:09:13.124376 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 629/1255] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:09:12 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:17.104878 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=7 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:17.105622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=69 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:17.269404 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.269905 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.276014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.276496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.277261 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.277700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.307036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82767aa3-6b9b-4fa0-bc1d-2eceabd27b99 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments/d7b572dd-a77b-4e05-a6b1-c4acdd6959c4" status: 200 len: 194 microversion: 2.20 time: 0.208003 Jul 14 16:10:17.307600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 627/1256] 10.222.0.119 () {60 vars in 1458 bytes} [Thu Jul 14 16:10:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments/d7b572dd-a77b-4e05-a6b1-c4acdd6959c4 => generated 194 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 16:10:17.368138 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=11 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:17.368885 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=89 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:17.373044 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.373534 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.379761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.380241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.381002 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.381434 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.461078 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lazy-loading 'services' on Instance uuid 1556002e-581e-4aee-880d-f517f5513652 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:10:17.689624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f3d91582-7cad-49be-b1f4-f6d90a6705cd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments/d7b572dd-a77b-4e05-a6b1-c4acdd6959c4" status: 202 len: 0 microversion: 2.20 time: 0.323015 Jul 14 16:10:17.690217 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 630/1257] 10.222.0.119 () {60 vars in 1461 bytes} [Thu Jul 14 16:10:17 2022] DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments/d7b572dd-a77b-4e05-a6b1-c4acdd6959c4 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:10:17.698702 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.704300 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.706124 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.706603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.707362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.707793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.737151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d670884b-7182-4d00-9468-8bd15300dbb6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042479 Jul 14 16:10:17.738709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 628/1258] 10.222.0.119 () {60 vars in 1347 bytes} [Thu Jul 14 16:10:17 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:10:18.751206 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:18.752235 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:18.758497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.758950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.759717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.760184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.789993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8656265a-7b9d-4763-9dc0-9c4adf2d4f24 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044698 Jul 14 16:10:18.790538 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 631/1259] 10.222.0.119 () {60 vars in 1347 bytes} [Thu Jul 14 16:10:18 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:10:19.801581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.802537 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.809144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.809601 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.810411 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.810882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.841308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41080c0e-bd12-419c-a110-867d0a8f4e1c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043565 Jul 14 16:10:19.841951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 629/1260] 10.222.0.119 () {60 vars in 1347 bytes} [Thu Jul 14 16:10:19 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:19.903414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.904029 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.911117 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.911567 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.912359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.912798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.939042 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:10:20.294847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89dee799-5676-4897-870f-86314387a690 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 204 len: 0 microversion: 2.20 time: 0.395250 Jul 14 16:10:20.295441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 632/1261] 10.222.0.119 () {60 vars in 1284 bytes} [Thu Jul 14 16:10:19 2022] DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:10:20.303682 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:20.304376 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:20.310390 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.310839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.311595 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.312572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.455895 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.464183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.465637 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.466882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c23d6227-7023-46d5-9176-12a856312901 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.167075 Jul 14 16:10:20.467434 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 630/1262] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:20 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:21.489475 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:21.490921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:21.499375 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.502193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.502193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.502193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.641137 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.649364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.650867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.652028 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a2fc00d-af1d-41d8-bff3-70b246209a27 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.170097 Jul 14 16:10:21.652797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 633/1263] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:21 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:22.670631 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:22.671213 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:22.678511 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.678968 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.679708 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.680199 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.831317 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.839756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.841396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.842545 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96816289-67b8-45ba-bb5d-1aff993eb2b6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.175774 Jul 14 16:10:22.843103 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 631/1264] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:22 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:23.863114 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:23.863761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:23.870354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.870812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.871587 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.872027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.102362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.111264 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.113035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.114304 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7699f79f-bc73-4848-82f8-edf5b37d5869 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1728 microversion: 2.20 time: 0.256199 Jul 14 16:10:24.115054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 634/1265] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:23 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:24.718156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-567e394e-2cdd-422f-8cea-577cac51873a req-f217de8b-9147-48c0-9bdd-a24e686002c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556002e-581e-4aee-880d-f517f5513652", "name": "network-vif-deleted", "tag": "6dec8b05-afcf-441d-8a1d-343566bbfe9d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:24.728727 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-567e394e-2cdd-422f-8cea-577cac51873a req-f217de8b-9147-48c0-9bdd-a24e686002c0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.729561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-567e394e-2cdd-422f-8cea-577cac51873a req-f217de8b-9147-48c0-9bdd-a24e686002c0 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.745417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-567e394e-2cdd-422f-8cea-577cac51873a req-f217de8b-9147-48c0-9bdd-a24e686002c0 service nova] Creating event network-vif-deleted:6dec8b05-afcf-441d-8a1d-343566bbfe9d for instance 1556002e-581e-4aee-880d-f517f5513652 on hv-cinder-84986 Jul 14 16:10:24.756541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-567e394e-2cdd-422f-8cea-577cac51873a req-f217de8b-9147-48c0-9bdd-a24e686002c0 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179353 Jul 14 16:10:24.757726 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 632/1266] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:25.133861 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:25.134915 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:25.142091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.142723 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.143598 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.144168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.177577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.178025 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.178479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lazy-loading 'fault' on Instance uuid 1556002e-581e-4aee-880d-f517f5513652 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:10:25.240733 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.251788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.260280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.260280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-672a73e4-e8f4-4591-a55b-231a2b36005c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 200 len: 1376 microversion: 2.20 time: 0.125635 Jul 14 16:10:25.262016 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 635/1267] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:25 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 1376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:26.275238 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:26.276448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:26.283477 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.283991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.284775 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.285207 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.299588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 HTTP/1.1 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:10:26.301281 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:10:26.302934 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '1556002e-581e-4aee-880d-f517f5513652'} Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:10:26.303767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:10:26.305231 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:10:26.306972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:10:26.306972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bf1e238c-93c6-4398-b351-a26b4c2e84d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 404 len: 111 microversion: 2.20 time: 0.031913 Jul 14 16:10:26.306972 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 633/1268] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:26 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:10:26.312453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ce9b76b-4eab-4730-bb3c-fdb1f8044efd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '.version_select at 0x7f0dc1f92f70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:26.411104 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ce9b76b-4eab-4730-bb3c-fdb1f8044efd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037907091" status: 204 len: 0 microversion: 2.20 time: 0.102595 Jul 14 16:10:26.411707 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 636/1269] 10.222.0.119 () {60 vars in 1266 bytes} [Thu Jul 14 16:10:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037907091 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:10:27.202175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82e4389c-2d17-42d7-8ad4-1cbca6d596dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: .version_select at 0x7f0dc66d3e50>, body: {"keypair": {"name": "tempest-keypair-839802891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpHOSF1f2TYx7N3FnMj+bDgcrLPJVKOhNav61TYBhB4J/a10QGggj7fps//D3rF0VhaoPYLtYq4Nv4Kia/VmWB+h6uvB7JI22022JplV9dBoUC4AlGqzCFaZQyPUsRBg=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:27.218964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-82e4389c-2d17-42d7-8ad4-1cbca6d596dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for project f50528750c0e4504aaafba1ebae3f707. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:10:27.223515 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-82e4389c-2d17-42d7-8ad4-1cbca6d596dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for user 8874a26203f0408f8d8c9f26b2818b59 and project f50528750c0e4504aaafba1ebae3f707. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:10:27.324924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82e4389c-2d17-42d7-8ad4-1cbca6d596dc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126545 Jul 14 16:10:27.326932 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 634/1270] 10.222.0.119 () {62 vars in 1204 bytes} [Thu Jul 14 16:10:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 16:10:29.772822 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1312652953", "imageRef": "01c4708d-a2e3-4c78-9768-9ddd1646bab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b3927a5-e351-442d-a0b8-241c848eece6"}], "security_groups": [{"name": "tempest-securitygroup--1447186553"}], "key_name": "tempest-keypair-839802891", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:29.908465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] validate_networks() for [('3b3927a5-e351-442d-a0b8-241c848eece6', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:10:30.305762 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:10:30.306192 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:10:30.306721 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:10:30.307134 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:10:30.307541 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:10:30.316728 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.317177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.317979 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.318414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.336270 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for project f50528750c0e4504aaafba1ebae3f707. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:10:30.340418 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Getting quotas for user 8874a26203f0408f8d8c9f26b2818b59 and project f50528750c0e4504aaafba1ebae3f707. Resources: {'ram', 'instances', 'cores'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:10:30.352386 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:10:30.354660 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01c4708d-a2e3-4c78-9768-9ddd1646bab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:10:30.499012 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1071b042-67dd-479e-afc8-645ff7bac8f0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.732476 Jul 14 16:10:30.499661 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 637/1271] 10.222.0.119 () {62 vars in 1192 bytes} [Thu Jul 14 16:10:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 14 16:10:30.509821 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:30.511129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:30.575996 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.585428 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.587023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.588653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ed3ae20c-a833-4e04-9751-2cc2fae6e0a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1285 microversion: 2.20 time: 0.082721 Jul 14 16:10:30.589119 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 635/1272] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:30 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:31.607788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:31.608535 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:31.616003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.616490 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.617266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.617708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.682549 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:31.691313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:31.692997 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:31.694121 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f30b8df-4715-4f05-9abb-4b5c71ed69d9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1289 microversion: 2.20 time: 0.090765 Jul 14 16:10:31.694722 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 638/1273] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:31 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:32.732860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:32.732860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:32.732860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.732860 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.733734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.733734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.808316 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:32.817201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:32.818775 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:32.819879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15981b1b-617a-478d-b98b-91626d365925 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1337 microversion: 2.20 time: 0.111408 Jul 14 16:10:32.820475 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 636/1274] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:32 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1337 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:33.837950 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:33.838717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:33.846787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.852749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.852749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.852749 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.918697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.937027 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.944705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.944705 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7ce4fb8-4c10-492e-b25d-76e14bf897d0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1343 microversion: 2.20 time: 0.110264 Jul 14 16:10:33.945186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 639/1275] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:33 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1343 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:34.964589 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:34.965129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:34.978518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.978518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.978518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.978518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.019403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-cef06993-4c65-467d-a05c-73a052df2b35 req-57c873e8-6130-4cf8-80a2-00482a856ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:35.034515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cef06993-4c65-467d-a05c-73a052df2b35 req-57c873e8-6130-4cf8-80a2-00482a856ae1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:35.040993 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cef06993-4c65-467d-a05c-73a052df2b35 req-57c873e8-6130-4cf8-80a2-00482a856ae1 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.050525 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-cef06993-4c65-467d-a05c-73a052df2b35 req-57c873e8-6130-4cf8-80a2-00482a856ae1 service nova] Creating event network-changed:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:10:35.056697 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-cef06993-4c65-467d-a05c-73a052df2b35 req-57c873e8-6130-4cf8-80a2-00482a856ae1 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043284 Jul 14 16:10:35.057453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 640/1276] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:10:35.196533 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:35.205793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:35.207719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:35.209045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-84751864-8e93-40f8-84f6-4f80b346bdc5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.248543 Jul 14 16:10:35.209719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 637/1277] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:34 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:36.227983 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:36.228735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:36.234883 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.235385 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.236725 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.237168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.385702 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.395111 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.396692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.397830 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-adaac762-901a-40fa-8a88-8d40483bd975 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.174551 Jul 14 16:10:36.398393 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 641/1278] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:36 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:37.414812 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:37.415417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:37.421910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.422353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.423664 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.424175 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.553348 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.561422 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.562958 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.564844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9707a354-0b6c-445e-95f3-8c7e8c41ec22 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.153962 Jul 14 16:10:37.565378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 638/1279] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:37 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:38.582410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:38.583020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:38.589574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.590018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.590774 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.591203 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.721787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:38.729725 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:38.731228 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:38.732498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8922a129-e915-4936-bd8d-5305275d37df tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.154003 Jul 14 16:10:38.732985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 642/1280] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:38 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:10:39.751107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:39.752448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:39.759046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.759497 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:39.760305 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.760742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:39.910131 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:39.913951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:39.915561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:39.916588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-255cbc37-b765-4cd4-bf74-fc492e7bf523 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.169782 Jul 14 16:10:39.917156 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 639/1281] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:39 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:40.934643 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:40.935253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:40.937771 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:40.938444 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:40.943312 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.943748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.944536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.944971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.078555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.085257 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.086781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.087905 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a90dabda-adb7-448d-9558-1096704c7433 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.157114 Jul 14 16:10:41.088527 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 643/1282] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:40 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:41.834709 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-dba53a84-e9f4-40a0-a602-4807beb1170e req-6ec188b6-624c-4ad3-bf85-71d21a4197a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "name": "network-vif-plugged", "status": "completed", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:41.838294 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:41.844180 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-dba53a84-e9f4-40a0-a602-4807beb1170e req-6ec188b6-624c-4ad3-bf85-71d21a4197a7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.844628 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-dba53a84-e9f4-40a0-a602-4807beb1170e req-6ec188b6-624c-4ad3-bf85-71d21a4197a7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.856656 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-dba53a84-e9f4-40a0-a602-4807beb1170e req-6ec188b6-624c-4ad3-bf85-71d21a4197a7 service nova] Creating event network-vif-plugged:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:10:41.862194 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-dba53a84-e9f4-40a0-a602-4807beb1170e req-6ec188b6-624c-4ad3-bf85-71d21a4197a7 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Jul 14 16:10:41.862781 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 640/1283] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:42.107632 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:42.108546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:42.116518 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.117233 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.118018 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.118492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.260248 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.269115 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.270731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.271840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7daa8093-93b1-4c16-b1d1-35b6201575f7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.169016 Jul 14 16:10:42.272427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 644/1284] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:42 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:43.291223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:43.291838 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:43.299260 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.299714 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.300521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.301266 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.435683 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:43.444000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:43.445529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:43.446621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0534b27-ee22-411f-9a7b-47e271ca0c61 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.160269 Jul 14 16:10:43.447167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 641/1285] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:43 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:44.464878 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:44.465514 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:44.472437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.472879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.473627 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.474054 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.608128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.616529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.618029 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.619126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5f5dde41-2837-470f-bcf6-622ac999a5ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1411 microversion: 2.20 time: 0.158134 Jul 14 16:10:44.619676 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 645/1286] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:44 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:10:45.637159 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:45.637767 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:45.644667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.645191 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.646032 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.646541 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.778202 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:45.786672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:45.788311 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:45.789688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20ce27dc-1095-48ca-9c0e-e2cbb153de9f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1603 microversion: 2.20 time: 0.156398 Jul 14 16:10:45.790325 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 642/1287] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:10:45 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1603 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:45.807574 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:45.808164 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:45.815367 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.815886 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.816735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.817244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.821417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:45.904712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-171d98e2-65cc-4cac-a339-90fbd33c6f2f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096879 Jul 14 16:10:45.904712 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 646/1288] 10.222.0.119 () {60 vars in 1320 bytes} [Thu Jul 14 16:10:45 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:10:46.923916 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-e3de46be-314d-47a3-8789-747f03f9eab7 req-669780d0-7207-4f61-a9d8-e56b3fa4fafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:46.933303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e3de46be-314d-47a3-8789-747f03f9eab7 req-669780d0-7207-4f61-a9d8-e56b3fa4fafd service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:46.933743 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e3de46be-314d-47a3-8789-747f03f9eab7 req-669780d0-7207-4f61-a9d8-e56b3fa4fafd service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:46.948073 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-e3de46be-314d-47a3-8789-747f03f9eab7 req-669780d0-7207-4f61-a9d8-e56b3fa4fafd service nova] Creating event network-changed:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:10:46.954198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-e3de46be-314d-47a3-8789-747f03f9eab7 req-669780d0-7207-4f61-a9d8-e56b3fa4fafd service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 Jul 14 16:10:46.958780 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 643/1289] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:31.816482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:31.820026 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:31.824973 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:31.825480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:31.828604 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=74 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:31.832751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-ec4b61b1-a4bf-499d-a36d-981b168c7a71 req-21ba9e1d-2d3d-4e8d-a148-0cc6e0d015a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:31.839085 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.839564 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.840503 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.840939 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.841223 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ec4b61b1-a4bf-499d-a36d-981b168c7a71 req-21ba9e1d-2d3d-4e8d-a148-0cc6e0d015a8 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.841672 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ec4b61b1-a4bf-499d-a36d-981b168c7a71 req-21ba9e1d-2d3d-4e8d-a148-0cc6e0d015a8 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.853562 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-ec4b61b1-a4bf-499d-a36d-981b168c7a71 req-21ba9e1d-2d3d-4e8d-a148-0cc6e0d015a8 service nova] Creating event network-changed:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:11:31.861945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-ec4b61b1-a4bf-499d-a36d-981b168c7a71 req-21ba9e1d-2d3d-4e8d-a148-0cc6e0d015a8 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041020 Jul 14 16:11:31.861945 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 644/1290] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:31.874058 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:11:32.222997 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a8fbde88-4c53-4bce-a31f-8bf257ceb48c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "DELETE /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 204 len: 0 microversion: 2.1 time: 0.407690 Jul 14 16:11:32.227031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 647/1291] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:11:31 2022] DELETE /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:11:32.233142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:32.234177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:32.242473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.244365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.244365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.244365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.399691 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:32.407798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b2596bd-07b4-4bf6-8ac8-7e480c9c1567 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.179333 Jul 14 16:11:32.408424 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 645/1292] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:32 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:33.425982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:33.426675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:33.433189 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.433745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.434582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.435011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.587402 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:33.596522 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-056b1cbf-c28b-4a90-a868-39f49942ff71 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1572 microversion: 2.1 time: 0.174782 Jul 14 16:11:33.597086 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 648/1293] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:33 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1572 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:34.615028 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:34.615617 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:34.622546 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.623002 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.623768 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.624253 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.757227 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:34.765352 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-927ec4eb-e2ac-4dc7-aa8b-2b94fba3bf87 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1453 microversion: 2.1 time: 0.154254 Jul 14 16:11:34.765865 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 646/1294] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:34 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:35.441011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f2d414da-7c05-4d23-80aa-700714d934b6 req-c456b23c-91d2-4afe-b123-2ff6819ba12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671e535d-0d05-4760-a181-1dba2d2c6a48", "name": "network-vif-deleted", "tag": "e1ef32e4-cb19-48f1-be96-7f7fc2032c63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:35.453865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f2d414da-7c05-4d23-80aa-700714d934b6 req-c456b23c-91d2-4afe-b123-2ff6819ba12f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.456169 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f2d414da-7c05-4d23-80aa-700714d934b6 req-c456b23c-91d2-4afe-b123-2ff6819ba12f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.465382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f2d414da-7c05-4d23-80aa-700714d934b6 req-c456b23c-91d2-4afe-b123-2ff6819ba12f service nova] Creating event network-vif-deleted:e1ef32e4-cb19-48f1-be96-7f7fc2032c63 for instance 671e535d-0d05-4760-a181-1dba2d2c6a48 on hv-cinder-84986 Jul 14 16:11:35.470116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f2d414da-7c05-4d23-80aa-700714d934b6 req-c456b23c-91d2-4afe-b123-2ff6819ba12f service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Jul 14 16:11:35.471033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 649/1295] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:35.782754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:35.783383 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:35.790623 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.791193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.792055 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.792633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.870410 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:35.879437 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b65c226-62c5-4299-bfd4-da3ec8fa9e8c tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1222 microversion: 2.1 time: 0.100600 Jul 14 16:11:35.880016 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 647/1296] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:35 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:35.946806 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:11:35.946984 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:11:36.897819 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:36.898519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:36.905787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.906232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.907234 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.907913 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.940412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.940858 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.941305 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lazy-loading 'fault' on Instance uuid 671e535d-0d05-4760-a181-1dba2d2c6a48 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:11:37.111686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78eff78e8564d0ba386bcd02137aa35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7469c47f14be40df88cc57050d28e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:37.111686 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-24c604f6-3329-4b1e-af13-d714fae166a4 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 200 len: 1181 microversion: 2.1 time: 0.218824 Jul 14 16:11:37.112262 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 650/1297] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:36 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 1181 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:38.129137 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:38.129751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] [instance: 671e535d-0d05-4760-a181-1dba2d2c6a48] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:38.136221 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.136666 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.137416 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.138346 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.153341 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] HTTP exception thrown: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Request method failure captured: Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 HTTP/1.1 Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D6W1fAaWAPwoJyJi32fxp1-Y0arcc3gHGVOoPGOLHEWyJ9XJg-WblV1yttkI4IvSDvAofFE_rWrhGK7xfmnjKUDpdmmP3kPPH9SdmGefto57YRUeuuFXXpi1WfWl-gtDNnh49SGAeUFgfhi5mZ2770sdIf8mVUKrHxgf3KjObJiGRI Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 7469c47f14be40df88cc57050d28e8ba Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestShelveInstance-2047849842 Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:11:38.155531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7469c47f14be40df88cc57050d28e8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/7469c47f14be40df88cc57050d28e8ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_7469c47f14be40df88cc57050d28e8ba", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/7469c47f14be40df88cc57050d28e8ba"}]}] Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestShelveInstance-2047849842 Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 7469c47f14be40df88cc57050d28e8ba Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestShelveInstance-2047849842 Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestShelveInstance-2047849842-project Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: c78eff78e8564d0ba386bcd02137aa35 Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestShelveInstance-2047849842-project Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. Jul 14 16:11:38.157398 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '671e535d-0d05-4760-a181-1dba2d2c6a48'} Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:11:38.158505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. Jul 14 16:11:38.160086 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:38.161756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Returning 404 to user: Instance 671e535d-0d05-4760-a181-1dba2d2c6a48 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:11:38.161756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0cc3644b-ee16-4be7-97f6-c4f03adf6c40 tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48" status: 404 len: 111 microversion: 2.1 time: 0.031701 Jul 14 16:11:38.161756 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 648/1298] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:38 2022] GET /compute/v2.1/servers/671e535d-0d05-4760-a181-1dba2d2c6a48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:11:38.392048 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b78e02de-d33e-44c4-b56c-2924a69511af tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] Calling method '.version_select at 0x7f0dc668c700>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:38.474035 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b78e02de-d33e-44c4-b56c-2924a69511af tempest-TestShelveInstance-2047849842 tempest-TestShelveInstance-2047849842-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905132168" status: 202 len: 0 microversion: 2.1 time: 0.086402 Jul 14 16:11:38.474617 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 651/1299] 10.222.0.119 () {58 vars in 1255 bytes} [Thu Jul 14 16:11:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905132168 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:11:46.733605 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:46.739670 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-5f47f969-b3fe-46ab-97a0-ba1dcea7a664 req-6dd610b8-ca8c-4709-a844-53b930dda0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7a606b-3d68-4e3b-aa83-850fad7ab0b2", "tag": "90554f6b-eff0-444e-8bc6-754f61980b63"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:46.743946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:46.752353 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5f47f969-b3fe-46ab-97a0-ba1dcea7a664 req-6dd610b8-ca8c-4709-a844-53b930dda0d3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.752799 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5f47f969-b3fe-46ab-97a0-ba1dcea7a664 req-6dd610b8-ca8c-4709-a844-53b930dda0d3 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.759724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.760286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.761062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.761496 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.767123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-5f47f969-b3fe-46ab-97a0-ba1dcea7a664 req-6dd610b8-ca8c-4709-a844-53b930dda0d3 service nova] Creating event network-changed:90554f6b-eff0-444e-8bc6-754f61980b63 for instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 on hv-cinder-84986 Jul 14 16:11:46.772487 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-5f47f969-b3fe-46ab-97a0-ba1dcea7a664 req-6dd610b8-ca8c-4709-a844-53b930dda0d3 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 Jul 14 16:11:46.773745 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 652/1300] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:46.791551 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:11:47.074110 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad29e8b0-ead2-4f2f-b455-7ef9a29dba03 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "DELETE /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 204 len: 0 microversion: 2.1 time: 0.343201 Jul 14 16:11:47.074924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 649/1301] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:11:46 2022] DELETE /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:11:47.085923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:47.086707 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:47.094346 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.095038 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.096315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.096924 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.246022 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:47.255677 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bf94b932-ec18-4165-964f-9c596ba3a5f8 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1580 microversion: 2.1 time: 0.174204 Jul 14 16:11:47.256280 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 653/1302] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:47 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1580 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:48.274522 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:48.275129 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:48.282081 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.282532 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.283297 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.283758 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.421772 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:48.429380 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4de2c564-194d-4ab4-b293-8c5c891d8309 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1580 microversion: 2.1 time: 0.159182 Jul 14 16:11:48.429935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 650/1303] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:48 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:49.446938 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:49.447560 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:49.454701 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.455182 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.455991 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.456460 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.589382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:49.598241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-113904b6-c100-4c7f-9dcd-90d23e104050 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1461 microversion: 2.1 time: 0.155309 Jul 14 16:11:49.598931 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 654/1304] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:49 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1461 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:49.671372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-83419f50-6f47-459b-afdd-76d224518dbe req-788e5864-4a1b-4c85-8d4d-f74276b27c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7a606b-3d68-4e3b-aa83-850fad7ab0b2", "name": "network-vif-deleted", "tag": "90554f6b-eff0-444e-8bc6-754f61980b63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:49.679983 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-83419f50-6f47-459b-afdd-76d224518dbe req-788e5864-4a1b-4c85-8d4d-f74276b27c3f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.680463 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-83419f50-6f47-459b-afdd-76d224518dbe req-788e5864-4a1b-4c85-8d4d-f74276b27c3f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.691940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-83419f50-6f47-459b-afdd-76d224518dbe req-788e5864-4a1b-4c85-8d4d-f74276b27c3f service nova] Creating event network-vif-deleted:90554f6b-eff0-444e-8bc6-754f61980b63 for instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 on hv-cinder-84986 Jul 14 16:11:49.697702 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-83419f50-6f47-459b-afdd-76d224518dbe req-788e5864-4a1b-4c85-8d4d-f74276b27c3f service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029841 Jul 14 16:11:49.698252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 651/1305] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:50.615181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:50.615794 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:50.622366 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.622817 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.623828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.624334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.657066 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.657515 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.657959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lazy-loading 'fault' on Instance uuid df7a606b-3d68-4e3b-aa83-850fad7ab0b2 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:11:50.700821 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:50.708928 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62182dbb-97b9-403c-801f-86faf3e4e7f3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 200 len: 1233 microversion: 2.1 time: 0.097608 Jul 14 16:11:50.709499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 655/1306] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:50 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:51.727013 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:51.727678 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: df7a606b-3d68-4e3b-aa83-850fad7ab0b2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:51.735469 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.736854 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.736854 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.737212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.750991 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] HTTP exception thrown: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Request method failure captured: Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 HTTP/1.1 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D3E46mK1NasiHo4tw0bqETJ3hYy2pmT_aNoVvLPYVel7Mi9RsMkYOwC4Z6bXW1752WAcCTcrX-GRXqLo_1LufWdxTfZNaV4mOCf50y5BcKjexMbCG0wb2uCvJi1ixameZJsV4ccp8YspWA0R5fXOK5qB5d5J2EQ7qI68YQxtEzpqPg Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:11:51.752734 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_1207210005f34c4aabbe6966e469c1a0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}] Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 56191d451ddf4fba953c27dd79484723 Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. Jul 14 16:11:51.754626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'df7a606b-3d68-4e3b-aa83-850fad7ab0b2'} Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:11:51.755625 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. Jul 14 16:11:51.757457 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:51.759098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Returning 404 to user: Instance df7a606b-3d68-4e3b-aa83-850fad7ab0b2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:11:51.759098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38edb52e-108b-4a4b-8622-95325402fc24 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2" status: 404 len: 111 microversion: 2.1 time: 0.031377 Jul 14 16:11:51.759098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 652/1307] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:51 2022] GET /compute/v2.1/servers/df7a606b-3d68-4e3b-aa83-850fad7ab0b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:11:55.359684 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:55.360241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:55.361727 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-fc348902-e7e5-4f4f-ba0e-0185d8d25e20 req-8a515da9-3b7e-4355-9c9d-4ef36a2cec20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bb734-5f8d-485f-8d5e-a8aca01672ae", "tag": "d245e393-87e8-4b90-a68d-82aaa0421e63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:55.366914 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.367596 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.368410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.369068 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.370689 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc348902-e7e5-4f4f-ba0e-0185d8d25e20 req-8a515da9-3b7e-4355-9c9d-4ef36a2cec20 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.371201 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc348902-e7e5-4f4f-ba0e-0185d8d25e20 req-8a515da9-3b7e-4355-9c9d-4ef36a2cec20 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.384927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-fc348902-e7e5-4f4f-ba0e-0185d8d25e20 req-8a515da9-3b7e-4355-9c9d-4ef36a2cec20 service nova] Creating event network-changed:d245e393-87e8-4b90-a68d-82aaa0421e63 for instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae on hv-cinder-84986 Jul 14 16:11:55.390480 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-fc348902-e7e5-4f4f-ba0e-0185d8d25e20 req-8a515da9-3b7e-4355-9c9d-4ef36a2cec20 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032796 Jul 14 16:11:55.391308 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 653/1308] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:55.397847 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:11:55.770602 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b085ebc-beb2-4087-bfdc-e796b7e59bc0 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "DELETE /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 204 len: 0 microversion: 2.1 time: 0.415217 Jul 14 16:11:55.771929 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 656/1309] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:11:55 2022] DELETE /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:11:55.781797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:55.787067 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:55.789169 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.789622 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.790673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.790889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.946529 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:55.956319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8fd0fd4-4f8e-4078-aee7-aa75cffc0ad2 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1582 microversion: 2.1 time: 0.179240 Jul 14 16:11:55.957237 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 654/1310] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:55 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1582 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:56.974700 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:56.975570 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:56.981841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.983184 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.984244 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.984683 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.118008 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:57.126748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b40d025f-6308-4aed-8957-53a552c7a713 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1463 microversion: 2.1 time: 0.156788 Jul 14 16:11:57.127318 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 657/1311] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:56 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:57.404692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-a5ff475d-0a6d-4557-926b-6edda886ed6c req-ccfbf38c-1692-4c70-932c-f91840eae062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bb734-5f8d-485f-8d5e-a8aca01672ae", "name": "network-vif-deleted", "tag": "d245e393-87e8-4b90-a68d-82aaa0421e63"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:11:57.413481 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-a5ff475d-0a6d-4557-926b-6edda886ed6c req-ccfbf38c-1692-4c70-932c-f91840eae062 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.413925 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-a5ff475d-0a6d-4557-926b-6edda886ed6c req-ccfbf38c-1692-4c70-932c-f91840eae062 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.425765 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-a5ff475d-0a6d-4557-926b-6edda886ed6c req-ccfbf38c-1692-4c70-932c-f91840eae062 service nova] Creating event network-vif-deleted:d245e393-87e8-4b90-a68d-82aaa0421e63 for instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae on hv-cinder-84986 Jul 14 16:11:57.430757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-a5ff475d-0a6d-4557-926b-6edda886ed6c req-ccfbf38c-1692-4c70-932c-f91840eae062 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Jul 14 16:11:57.431553 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 655/1312] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:11:58.143720 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:58.144427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:58.151004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.151465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.152266 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.152708 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.183224 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.183675 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.184143 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lazy-loading 'fault' on Instance uuid 4f6bb734-5f8d-485f-8d5e-a8aca01672ae {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:11:58.226917 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56191d451ddf4fba953c27dd79484723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1207210005f34c4aabbe6966e469c1a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:58.234437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e8bc4c0-a59b-4700-92d0-1f25206dabda tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 200 len: 1234 microversion: 2.1 time: 0.095550 Jul 14 16:11:58.235004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 658/1313] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:58 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:59.252561 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:59.253287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: 4f6bb734-5f8d-485f-8d5e-a8aca01672ae] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:59.259384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.262512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.262512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.262512 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.274634 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] HTTP exception thrown: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Request method failure captured: Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae HTTP/1.1 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D3E46mK1NasiHo4tw0bqETJ3hYy2pmT_aNoVvLPYVel7Mi9RsMkYOwC4Z6bXW1752WAcCTcrX-GRXqLo_1LufWdxTfZNaV4mOCf50y5BcKjexMbCG0wb2uCvJi1ixameZJsV4ccp8YspWA0R5fXOK5qB5d5J2EQ7qI68YQxtEzpqPg Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:11:59.276247 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_1207210005f34c4aabbe6966e469c1a0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}] Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 56191d451ddf4fba953c27dd79484723 Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. Jul 14 16:11:59.277987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '4f6bb734-5f8d-485f-8d5e-a8aca01672ae'} Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:11:59.279023 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. Jul 14 16:11:59.281868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.284946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Returning 404 to user: Instance 4f6bb734-5f8d-485f-8d5e-a8aca01672ae could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:11:59.284946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9d4c0bb5-19fd-41e0-aad0-0034ae743a81 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae" status: 404 len: 111 microversion: 2.1 time: 0.030578 Jul 14 16:11:59.284946 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 656/1314] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:59 2022] GET /compute/v2.1/servers/4f6bb734-5f8d-485f-8d5e-a8aca01672ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:11:59.797657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:59.798188 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:59.804582 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.805053 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.805812 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.806241 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.820036 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] HTTP exception thrown: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Request method failure captured: Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d HTTP/1.1 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D3E46mK1NasiHo4tw0bqETJ3hYy2pmT_aNoVvLPYVel7Mi9RsMkYOwC4Z6bXW1752WAcCTcrX-GRXqLo_1LufWdxTfZNaV4mOCf50y5BcKjexMbCG0wb2uCvJi1ixameZJsV4ccp8YspWA0R5fXOK5qB5d5J2EQ7qI68YQxtEzpqPg Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:11:59.821706 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_1207210005f34c4aabbe6966e469c1a0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}] Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 56191d451ddf4fba953c27dd79484723 Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.823382 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'ffdf0e60-fc39-4efd-82dc-737d584be96d'} Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:11:59.824415 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.826050 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.827788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Returning 404 to user: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:11:59.827788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a5698603-9b32-4105-8832-66cce2245ab3 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "DELETE /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 404 len: 111 microversion: 2.1 time: 0.030072 Jul 14 16:11:59.827788 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 659/1315] 10.222.0.119 () {58 vars in 1243 bytes} [Thu Jul 14 16:11:59 2022] DELETE /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:11:59.831939 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:59.832599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] [instance: ffdf0e60-fc39-4efd-82dc-737d584be96d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:59.838558 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.839006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.839764 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.840226 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.855837 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] HTTP exception thrown: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Request method failure captured: Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d HTTP/1.1 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D3E46mK1NasiHo4tw0bqETJ3hYy2pmT_aNoVvLPYVel7Mi9RsMkYOwC4Z6bXW1752WAcCTcrX-GRXqLo_1LufWdxTfZNaV4mOCf50y5BcKjexMbCG0wb2uCvJi1ixameZJsV4ccp8YspWA0R5fXOK5qB5d5J2EQ7qI68YQxtEzpqPg Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:11:59.857382 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/1207210005f34c4aabbe6966e469c1a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_1207210005f34c4aabbe6966e469c1a0", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/1207210005f34c4aabbe6966e469c1a0"}]}] Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 1207210005f34c4aabbe6966e469c1a0 Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestVolumeBootPattern-158268696 Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 56191d451ddf4fba953c27dd79484723 Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestVolumeBootPattern-158268696-project Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.859811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'ffdf0e60-fc39-4efd-82dc-737d584be96d'} Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:11:59.860896 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. Jul 14 16:11:59.862479 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:11:59.863943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Returning 404 to user: Instance ffdf0e60-fc39-4efd-82dc-737d584be96d could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:11:59.863943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff1f3ba3-7eed-49a2-9c13-57f2c802933b tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d" status: 404 len: 111 microversion: 2.1 time: 0.031916 Jul 14 16:11:59.863943 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 657/1316] 10.222.0.119 () {58 vars in 1240 bytes} [Thu Jul 14 16:11:59 2022] GET /compute/v2.1/servers/ffdf0e60-fc39-4efd-82dc-737d584be96d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:12:01.426480 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb1197a8-a7c3-4b27-a033-66d76c092844 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] Calling method '.version_select at 0x7f0dc1e0d0d0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:01.515362 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb1197a8-a7c3-4b27-a033-66d76c092844 tempest-TestVolumeBootPattern-158268696 tempest-TestVolumeBootPattern-158268696-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2057527239" status: 202 len: 0 microversion: 2.1 time: 0.092633 Jul 14 16:12:01.515987 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 660/1317] 10.222.0.119 () {58 vars in 1267 bytes} [Thu Jul 14 16:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2057527239 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:12:02.356113 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:02.360409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:02.360409 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:02.364119 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.364581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.365372 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.365822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.369540 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:02.389309 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38a079d1-11bf-48e3-a399-e9f2eadb3816 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/ips" status: 200 len: 151 microversion: 2.20 time: 0.037441 Jul 14 16:12:02.390142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 658/1318] 10.222.0.119 () {60 vars in 1293 bytes} [Thu Jul 14 16:12:02 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:12:04.973482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:04.974614 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:04.976736 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:04.983388 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.984057 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.985571 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.986021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.990337 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:05.015273 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lazy-loading 'flavor' on Instance uuid fda75890-b40a-46df-8cce-6881fe48b132 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:12:05.539545 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5f5e77fa-8b60-48c1-842e-dc4f9fbab8ca tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/action" status: 202 len: 0 microversion: 2.20 time: 0.570773 Jul 14 16:12:05.540200 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 661/1319] 10.222.0.119 () {62 vars in 1323 bytes} [Thu Jul 14 16:12:04 2022] POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:12:05.548822 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:05.549436 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:05.557849 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.564659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.564659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.564659 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.823454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:05.833072 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:05.834579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:05.836043 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f662e1a2-274f-4489-851a-232e8bb71166 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.291616 Jul 14 16:12:05.837019 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 659/1320] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:05 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:06.859079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:06.859848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:06.866956 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.867735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.868692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.869337 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.007617 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.016069 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.017757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.018948 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cef9d3de-fe10-4ac6-997d-ea69efe24fd4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.165408 Jul 14 16:12:07.019530 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 662/1321] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:06 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:08.037006 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:08.037639 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:08.046075 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.046527 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.047302 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.047742 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.186021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.194066 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.195588 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.196879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e0dbf6f3-e5ed-43c5-aa14-99e9de1d54ef tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.163662 Jul 14 16:12:08.197431 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 660/1322] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:08 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:09.214513 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:09.215118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:09.221867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.222314 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.223071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.223506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.353185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.362253 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.363764 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.364961 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b997efe6-a730-40b8-9101-a35a0629fc4f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.154308 Jul 14 16:12:09.365511 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 663/1323] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:09 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:10.383927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.384574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.391882 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.392363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.393142 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.393592 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.561673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.569633 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.571128 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.572362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd48b5c9-6857-466d-b2e4-a8be9dfcb49d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.192763 Jul 14 16:12:10.572911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 661/1324] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:10 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:11.597031 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:11.597639 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:11.604398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.604865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.605619 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.606074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.738715 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.746709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.748523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.750004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2d6a1e7a-3291-477f-9a49-25e16020509b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.157835 Jul 14 16:12:11.750555 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 664/1325] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:11 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:12.768752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:12.769285 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:12.775722 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.776203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.776978 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.777423 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.913744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:12.922459 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:12.923982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:12.925173 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5237ace9-69e0-4aee-ba72-e3c00a979049 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.161081 Jul 14 16:12:12.925730 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 662/1326] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:12 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:13.943091 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:13.943731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:13.950223 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:13.950673 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.951506 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:13.952261 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.082383 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.090236 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.091791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.093227 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-08aa8195-f4ba-4d4d-9b02-30bfba3a169e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.154024 Jul 14 16:12:14.093787 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 665/1327] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:13 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:15.111673 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.112468 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.118997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.119455 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.120256 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.120700 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.257198 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.265600 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.267107 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.268301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a3cedf2f-62df-4dc3-ad74-e7b0d448cea1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.161359 Jul 14 16:12:15.268850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 663/1328] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:15 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:16.286565 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:16.287126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:16.293581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.294030 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.294791 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.295381 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.422890 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.430851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.432378 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.433569 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06998044-22b3-43bc-a5cc-99abde19f50d tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.151070 Jul 14 16:12:16.434123 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 666/1329] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:16 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:17.451401 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:17.452087 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:17.458684 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.459071 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.459830 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.460291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.595437 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.603635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.605176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.606319 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b59b4635-57a4-47e1-b11f-e6c8687d7a0e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.158836 Jul 14 16:12:17.606868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 664/1330] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:17 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:18.625453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:18.626092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:18.632757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.633206 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.633969 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.634409 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.763075 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.771607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.773163 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.774379 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-38030c0d-0837-4586-91cf-ee84e5c0e172 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.153707 Jul 14 16:12:18.774937 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 667/1331] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:18 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:19.793350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:19.793904 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:19.800724 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.801176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.801941 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.802378 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.934567 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:19.942621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:19.944157 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:19.945344 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-598de6fe-da20-4f12-b15b-1ca22391c85e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.156131 Jul 14 16:12:19.945899 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 665/1332] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:19 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:20.964092 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:20.964731 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:20.976176 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:20.976657 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:20.977436 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:20.977875 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.112119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:21.120067 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:21.121608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:21.122772 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ff4593c-0231-4316-ac19-af859bac2103 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.162633 Jul 14 16:12:21.123332 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 668/1333] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:20 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:22.140564 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-d43d0e3d-6dbf-4e83-9d78-d1d14918beae req-f499fd0d-0da4-480f-ab5a-13dd7b32f720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "name": "network-vif-plugged", "status": "completed", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:22.141140 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:22.141523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:22.148456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.148904 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.149464 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d43d0e3d-6dbf-4e83-9d78-d1d14918beae req-f499fd0d-0da4-480f-ab5a-13dd7b32f720 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.149668 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.149911 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d43d0e3d-6dbf-4e83-9d78-d1d14918beae req-f499fd0d-0da4-480f-ab5a-13dd7b32f720 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.150101 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.161844 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-d43d0e3d-6dbf-4e83-9d78-d1d14918beae req-f499fd0d-0da4-480f-ab5a-13dd7b32f720 service nova] Creating event network-vif-plugged:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:12:22.166895 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-d43d0e3d-6dbf-4e83-9d78-d1d14918beae req-f499fd0d-0da4-480f-ab5a-13dd7b32f720 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Jul 14 16:12:22.167559 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 666/1334] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:22.282479 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.290607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.292126 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.293284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f47ef92a-d68c-4f28-ad03-19fb0837b379 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.156381 Jul 14 16:12:22.293837 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 669/1335] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:22 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:23.314063 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:23.314757 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:23.321046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.321491 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.322251 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.322688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.457000 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.465143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.466667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.467832 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9a74d0d1-06d5-4002-ab17-35ab630477c4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1748 microversion: 2.20 time: 0.159237 Jul 14 16:12:23.468417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 667/1336] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:23 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:24.486963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:24.487577 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:24.494825 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.495576 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.496671 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.497343 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.678717 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.686867 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.688554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.689848 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d40d56f9-c0db-4750-9a47-4256eeb14d26 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.207604 Jul 14 16:12:24.690586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 670/1337] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:24 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:25.711782 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:25.712665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:25.723668 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.724293 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.725920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.726361 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.879607 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:25.893524 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:25.896967 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:25.900495 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c3828c5-e852-400d-ac82-4610878b8e30 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.193913 Jul 14 16:12:25.901263 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 668/1338] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:25 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:26.922921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:26.923529 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:26.930049 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:26.930500 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:26.931288 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:26.931724 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.069063 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.078967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.080565 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.081748 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e838650-6848-424e-bdbc-1ec444ba753c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.163384 Jul 14 16:12:27.082315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 671/1339] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:26 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:28.116667 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:28.117265 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:28.124150 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.125433 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.131275 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.131719 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.295035 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.303473 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.305021 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.306805 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9984f6d8-5423-457f-9a29-77fe0569fd32 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.202426 Jul 14 16:12:28.307747 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 669/1340] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:28 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:29.328496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:29.329081 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:29.335851 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.340441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.340441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.340441 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.487243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.496020 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.497655 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.498811 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77ad1efe-b774-48c2-b9b6-7e1bd3047abc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.175464 Jul 14 16:12:29.499659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 672/1341] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:29 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:30.523230 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:30.525059 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:30.534363 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.534732 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.535928 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.536635 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.700211 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.711663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.714370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.716606 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ddde4cb-96b1-4208-8fcc-4e2a7a6de33f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.202009 Jul 14 16:12:30.727584 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 670/1342] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:30 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:31.738863 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:31.739507 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:31.746521 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.747056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.747821 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.748439 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.890808 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:31.899796 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:31.901496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:31.902682 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8fd0d19c-efa3-4a14-8da2-c9f38d845e53 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.167921 Jul 14 16:12:31.915136 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 673/1343] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:31 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:32.923644 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:32.924467 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:32.930935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:32.931395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:32.932212 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:32.932653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.088662 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.097507 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.098995 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.100235 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-682ade7a-9775-43aa-abc5-5bf3b8a28749 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.181673 Jul 14 16:12:33.105130 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 671/1344] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:32 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:34.118804 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:34.119654 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:34.127798 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.128082 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.128879 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.129546 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.326185 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.337619 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.339368 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.340803 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0097000-1d9a-4bb1-9f9b-8afd6e875c8b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.226434 Jul 14 16:12:34.341523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 674/1345] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:34 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:35.360770 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:35.361368 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:35.367987 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.368472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.369229 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.369663 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.505276 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.513710 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.515766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.517395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a1104f3a-fba3-4531-9c96-efbf0d1a0ff7 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.160911 Jul 14 16:12:35.524676 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 672/1346] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:35 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:36.534874 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:36.535486 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:36.537971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:36.542786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.543232 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.543990 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.544448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.549204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:36.686144 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:36.694428 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:36.695985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:36.697177 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-580eefc5-29ad-4e23-b615-d864f5060a71 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1743 microversion: 2.20 time: 0.166282 Jul 14 16:12:36.697740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 675/1347] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:36 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:37.716269 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:37.716873 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:37.723769 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.724234 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.725094 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.725526 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.861406 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.869565 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.871092 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.872323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f1936fc-48af-48a1-906b-22f266f4bd14 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1725 microversion: 2.20 time: 0.159936 Jul 14 16:12:37.872891 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 673/1348] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:37 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:38.891779 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:38.892498 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:38.898916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.899357 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.900118 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.900557 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.027916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:39.036413 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:39.037944 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:39.039099 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2a9975d6-15c9-4930-96ef-3fb39e988afd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1725 microversion: 2.20 time: 0.151824 Jul 14 16:12:39.039665 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 676/1349] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:38 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:40.057302 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:40.057915 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:40.061665 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=32 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:40.065216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.066362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.066636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.067077 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.071234 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=90 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:40.193795 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-b9838bce-03db-48ff-8f1e-a6a9278824bf req-84e3ea12-4ecd-404a-a8c4-b0a91e379a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "name": "network-vif-unplugged", "status": "completed", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:40.210929 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.211129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b9838bce-03db-48ff-8f1e-a6a9278824bf req-84e3ea12-4ecd-404a-a8c4-b0a91e379a4a service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.211129 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-b9838bce-03db-48ff-8f1e-a6a9278824bf req-84e3ea12-4ecd-404a-a8c4-b0a91e379a4a service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.217574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.220184 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.221395 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ff9b5fd-66be-4e80-b6e1-1acf60e58012 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1725 microversion: 2.20 time: 0.167982 Jul 14 16:12:40.222520 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 674/1350] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:40 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:40.223453 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-b9838bce-03db-48ff-8f1e-a6a9278824bf req-84e3ea12-4ecd-404a-a8c4-b0a91e379a4a service nova] Creating event network-vif-unplugged:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:12:40.234496 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-b9838bce-03db-48ff-8f1e-a6a9278824bf req-84e3ea12-4ecd-404a-a8c4-b0a91e379a4a service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047106 Jul 14 16:12:40.235119 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 677/1351] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:12:41.241456 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:41.242062 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:41.248671 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.249203 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.250005 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.250446 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.376863 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.384889 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.386482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.387636 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9338f509-6db9-4759-98ea-02321c71ccad tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1668 microversion: 2.20 time: 0.150547 Jul 14 16:12:41.388215 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 675/1352] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:41 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:41.412510 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2261dd70-7eb4-494f-a0de-a468efc2e7dd"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:41.414005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:41.420313 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.422523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.422523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.422855 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.376519 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fabbd6d7-d148-4048-a6b0-5335458c0029 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.968243 Jul 14 16:12:42.377186 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 678/1353] 10.222.0.119 () {62 vars in 1368 bytes} [Thu Jul 14 16:12:41 2022] POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments => generated 188 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:12:42.491328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:42.491886 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:42.498323 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.498744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.500167 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.500759 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.134580 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-190b8e0b-c8fc-4e17-be3c-ec5343980359 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments/2261dd70-7eb4-494f-a0de-a468efc2e7dd" status: 202 len: 0 microversion: 2.20 time: 0.647146 Jul 14 16:12:43.135179 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 676/1354] 10.222.0.119 () {60 vars in 1461 bytes} [Thu Jul 14 16:12:42 2022] DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments/2261dd70-7eb4-494f-a0de-a468efc2e7dd => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:12:43.190841 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:43.191401 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:43.198435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:43.198877 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.199633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:43.200062 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.411130 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [580d46fa-2e5e-477a-8c19-1014d3c28bc0] AMQP server on 10.222.0.119:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:12:44.418608 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [580d46fa-2e5e-477a-8c19-1014d3c28bc0] Reconnected to AMQP server on 10.222.0.119:5672 via [amqp] client with port 42508. Jul 14 16:12:44.422611 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4e53e106-965c-4e5d-9864-79ecf719cfb5 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/action" status: 202 len: 0 microversion: 2.20 time: 1.235948 Jul 14 16:12:44.423296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 679/1355] 10.222.0.119 () {62 vars in 1323 bytes} [Thu Jul 14 16:12:43 2022] POST /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/action => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:12:44.431286 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:44.431980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:44.439124 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.439570 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.440396 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.440834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.579183 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.588370 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.589879 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.591058 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2748b3bb-4a1b-4d28-8780-78f0fb9d395c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1676 microversion: 2.20 time: 0.163672 Jul 14 16:12:44.591612 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 677/1356] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:44 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:45.611859 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:45.612470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:45.619483 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.619921 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.620703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.621132 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.754204 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.762550 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.764071 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.765284 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1683641-ddb3-4ddd-bdba-74c95c062558 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1676 microversion: 2.20 time: 0.158354 Jul 14 16:12:45.766003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 680/1357] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:45 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:46.787461 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:46.788090 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:46.794698 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.795149 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.795965 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.797045 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.931744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:46.939793 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:46.941384 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:46.942599 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8abcf006-1508-4d73-aa71-bb2a9b389fbc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.159137 Jul 14 16:12:46.943151 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 678/1358] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:46 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:47.961370 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:47.961992 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:47.969245 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:47.969691 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:47.970470 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:47.970900 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.124263 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.133193 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.134694 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.135870 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-93e97552-fb92-4546-80e5-384ecd491562 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.179065 Jul 14 16:12:48.136492 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 681/1359] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:47 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:49.155020 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:49.155728 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:49.163513 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.163964 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.164778 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.165320 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.307777 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.317611 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.319121 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.320331 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac138cf6-bac9-4cef-972c-d324919700bf tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.169189 Jul 14 16:12:49.321374 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 679/1360] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:49 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:50.338781 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:50.339412 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:50.348548 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.349116 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.349970 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.350482 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.491341 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.501238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.502873 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.504170 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0ec64654-00b3-4a3b-8b4e-c4361b30a81b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.169277 Jul 14 16:12:50.504732 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 682/1361] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:50 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:51.522555 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:51.523230 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:51.530365 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.530811 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.531692 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.532252 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.676403 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.685660 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.687193 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.689792 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-364aaa0b-bd7d-4d9a-9d34-a0173aabb7a2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.171393 Jul 14 16:12:51.701362 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 680/1362] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:51 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:52.709422 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:52.711566 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:52.717033 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.717509 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.718631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.719427 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.854139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:52.863128 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:52.864680 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:52.865850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f2a9bf8-9327-4bdb-a510-bd508d6142aa tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.160309 Jul 14 16:12:52.866624 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 683/1363] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:52 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:53.885030 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:53.885629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:53.893303 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.893754 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:53.894518 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.894982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:54.033448 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:54.042257 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:54.043927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:54.045350 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9861977f-5d47-42a2-94e9-51dfb62f5e6e tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.164136 Jul 14 16:12:54.045915 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 681/1364] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:53 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:55.063497 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:55.064296 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:55.071139 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.071589 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.072391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.072828 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.248036 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:55.259527 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:55.261198 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:55.262411 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8b266c5c-f1bc-4a09-b85b-1b1ac1f475e9 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.203313 Jul 14 16:12:55.263029 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 684/1365] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:55 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:56.284080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:56.284080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:56.291318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.291947 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.293047 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.293790 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.456917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:56.467333 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:56.469100 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:56.471302 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23fd55b0-c556-4ae6-a6e3-2a83d8688df2 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.193087 Jul 14 16:12:56.491664 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 682/1366] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:56 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:57.498833 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:57.499590 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:57.505805 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.506250 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.507021 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.507452 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.647900 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:57.655963 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:57.658238 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:57.659448 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02210d4e-8544-405c-85c2-d3d287e61c0a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.164504 Jul 14 16:12:57.660011 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 685/1367] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:57 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:58.677924 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:58.678574 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:58.685503 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.697814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.697814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.697814 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.817766 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:58.825907 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:58.827476 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:58.828670 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17dc7f57-5bc4-46c9-80a4-0916e767c0f3 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.154999 Jul 14 16:12:58.829997 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 683/1368] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:58 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:59.847621 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:59.853786 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:59.854840 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.855289 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.856048 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.856504 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.985417 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:59.993647 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:59.995171 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:59.996414 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2d2a45e2-5894-413b-972c-73e2c98f22a8 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.153476 Jul 14 16:12:59.996980 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 686/1369] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:12:59 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:01.014686 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:01.015324 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:01.022505 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:01.022951 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:01.023712 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:01.024184 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:01.156592 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:01.165472 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:01.166980 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:01.168155 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9063c3f-e044-4879-a0af-781c262755ea tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.157393 Jul 14 16:13:01.168749 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 684/1370] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:01 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:02.186039 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:02.186627 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:02.193181 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:02.193606 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:02.194359 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:02.194785 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:02.324985 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:02.332916 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:02.334456 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:02.335637 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67fdea63-cc20-4245-aed5-40bee279edf6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.153569 Jul 14 16:13:02.336205 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 687/1371] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:02 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:03.353857 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:03.354482 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:03.361098 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.361621 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.362391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.362834 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.499801 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:03.507913 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:03.509450 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:03.510638 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cbb51abd-7ae4-4eb7-a050-c415022bf496 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.160783 Jul 14 16:13:03.511510 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 685/1372] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:03 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:04.528709 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:04.529319 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:04.535919 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:04.536391 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:04.537157 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:04.537586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:04.666088 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:04.668465 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:04.675369 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:04.676934 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:04.685297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58fce428-8ea6-4334-876e-c31e6a31834a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.153287 Jul 14 16:13:04.685297 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 688/1373] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:04 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:05.696216 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:05.696868 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:05.703581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:05.703962 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:05.705470 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:05.705917 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:05.840014 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:05.848474 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:05.850310 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:05.852196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30f51c0b-33cd-4806-9dab-cb31c1c9dcb0 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.159196 Jul 14 16:13:05.852196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 686/1374] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:05 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:06.414649 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-3c526689-2f5c-409a-939c-26a0c76b14d7 req-73d303a8-a596-4c77-8a09-ba9408f9211f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "name": "network-vif-plugged", "status": "completed", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:06.424213 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3c526689-2f5c-409a-939c-26a0c76b14d7 req-73d303a8-a596-4c77-8a09-ba9408f9211f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:06.426982 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3c526689-2f5c-409a-939c-26a0c76b14d7 req-73d303a8-a596-4c77-8a09-ba9408f9211f service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:06.435442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-3c526689-2f5c-409a-939c-26a0c76b14d7 req-73d303a8-a596-4c77-8a09-ba9408f9211f service nova] Creating event network-vif-plugged:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:13:06.441607 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-3c526689-2f5c-409a-939c-26a0c76b14d7 req-73d303a8-a596-4c77-8a09-ba9408f9211f service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089876 Jul 14 16:13:06.442692 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 689/1375] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:06.869057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:06.869725 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:06.876176 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:06.876626 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:06.877391 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:06.877824 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.007581 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:07.015417 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:07.016963 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:07.018739 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0f26bb86-ca3b-4d3c-9b9c-201b80bf7d57 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.153544 Jul 14 16:13:07.019292 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 687/1376] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:06 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:08.038044 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:08.038746 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:08.040688 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=32 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:08.045703 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:08.046156 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:08.046923 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:08.047364 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:08.174523 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:08.182927 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:08.184472 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:08.185627 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6958787e-88d9-4e54-8d40-0b28dfb012da tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.152713 Jul 14 16:13:08.186209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 690/1377] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:08 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:09.204389 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:09.205549 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:09.212232 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.212685 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.213454 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.213988 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.218036 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:09.352576 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:09.360579 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:09.362277 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:09.363399 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-acd17603-b3b7-4d8e-afc2-ebcd7d155dd6 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1734 microversion: 2.20 time: 0.163056 Jul 14 16:13:09.363982 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 688/1378] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:09 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:10.382869 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:10.383474 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:10.390004 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.390454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.391219 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.391659 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.517435 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:10.525493 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:10.527028 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:10.528209 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1530fa7-2be3-4428-aabb-0a860d46d3fd tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1721 microversion: 2.20 time: 0.149625 Jul 14 16:13:10.528770 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 691/1379] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:13:10 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:13:16.629291 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:13:16.629797 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:14:06.012803 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:06.013800 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:06.017273 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=29 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:06.018057 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:06.022729 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.023177 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.023940 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.024407 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.052371 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99265df2-b8f9-4bfd-a0c2-31366aa6d4a4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043466 Jul 14 16:14:06.052918 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 689/1380] 10.222.0.119 () {60 vars in 1347 bytes} [Thu Jul 14 16:14:06 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:06.111216 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:06.111735 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:06.113750 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:06.114437 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=15 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:06.119188 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.124984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.124984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.124984 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.147168 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:14:06.381631 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-48826bac-8dfb-422f-b76c-b3fa3a841b68 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 204 len: 0 microversion: 2.20 time: 0.274326 Jul 14 16:14:06.382225 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 692/1381] 10.222.0.119 () {60 vars in 1284 bytes} [Thu Jul 14 16:14:06 2022] DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 16:14:06.390715 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:06.391328 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:06.398196 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.398649 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.399413 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.399850 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.531927 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:06.539780 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:06.541326 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:06.542504 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a26edd0b-f03b-4351-9dfb-2ec899f7b50c tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.156020 Jul 14 16:14:06.543060 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 690/1382] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:06 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:14:07.561757 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:07.562494 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:07.569398 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.569857 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.570633 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.571074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.706532 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:07.714442 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:07.715966 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:07.717653 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0266cc1a-e9ea-4cf0-a20f-db53ca83ddcc tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.159824 Jul 14 16:14:07.718836 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 693/1383] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:07 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:14:08.737408 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:08.738162 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:08.744688 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:08.745143 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:08.745910 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:08.746351 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:08.879808 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:08.887846 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:08.889414 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:08.890752 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-afa1f4ed-ddff-4dee-ac9d-412a23003d87 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1727 microversion: 2.20 time: 0.158102 Jul 14 16:14:08.891310 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 691/1384] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:08 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:14:09.296345 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-ece1cfbe-a06d-4166-bda4-be791e440b73 req-636e2534-4503-4b08-8656-38e4fa40c8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda75890-b40a-46df-8cce-6881fe48b132", "name": "network-vif-deleted", "tag": "73fe31bd-7b5e-463f-b8ac-99ab5907511a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:09.306337 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ece1cfbe-a06d-4166-bda4-be791e440b73 req-636e2534-4503-4b08-8656-38e4fa40c8b7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.306999 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ece1cfbe-a06d-4166-bda4-be791e440b73 req-636e2534-4503-4b08-8656-38e4fa40c8b7 service nova] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.320429 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-ece1cfbe-a06d-4166-bda4-be791e440b73 req-636e2534-4503-4b08-8656-38e4fa40c8b7 service nova] Creating event network-vif-deleted:73fe31bd-7b5e-463f-b8ac-99ab5907511a for instance fda75890-b40a-46df-8cce-6881fe48b132 on hv-cinder-84986 Jul 14 16:14:09.330559 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-ece1cfbe-a06d-4166-bda4-be791e440b73 req-636e2534-4503-4b08-8656-38e4fa40c8b7 service nova] 10.222.0.119 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094838 Jul 14 16:14:09.330559 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 694/1385] 10.222.0.119 () {64 vars in 1322 bytes} [Thu Jul 14 16:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:09.909084 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:09.909966 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:09.916653 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.917106 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.917881 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.918318 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.955791 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.956271 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.956720 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lazy-loading 'fault' on Instance uuid fda75890-b40a-46df-8cce-6881fe48b132 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:14:10.272823 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:10.281031 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:10.282531 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8874a26203f0408f8d8c9f26b2818b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50528750c0e4504aaafba1ebae3f707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:10.283769 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20f63c59-c3e2-45f7-a024-74ae051c9adb tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 200 len: 1375 microversion: 2.20 time: 0.378765 Jul 14 16:14:10.294521 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 692/1386] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:09 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 1375 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:14:11.303761 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:11.304581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:11.310797 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:11.311243 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:11.312003 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:11.312466 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:11.325354 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 HTTP/1.1 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:14:11.326959 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:11.329454 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'fda75890-b40a-46df-8cce-6881fe48b132'} Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:11.330583 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:11.332517 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:11.334079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:11.334079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0159490a-0c20-47b6-b3b4-0e4b8045a7ce tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 404 len: 111 microversion: 2.20 time: 0.029712 Jul 14 16:14:11.334079 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 695/1387] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:11 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:14:11.337608 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26f50dc4-7249-43fd-ad1f-ad89ec7045d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '.version_select at 0x7f0dc1ef78b0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:11.445629 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26f50dc4-7249-43fd-ad1f-ad89ec7045d4 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839802891" status: 204 len: 0 microversion: 2.20 time: 0.111798 Jul 14 16:14:11.446290 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 693/1388] 10.222.0.119 () {60 vars in 1263 bytes} [Thu Jul 14 16:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839802891 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:14:13.510860 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:13.511410 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:13.519142 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:13.519586 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:13.520372 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:13.520850 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:13.534056 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 HTTP/1.1 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:14:13.535650 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.537554 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': 'fda75890-b40a-46df-8cce-6881fe48b132'} Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:13.538740 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.540499 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.542106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:13.542106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c024f247-b510-4ca7-9a54-dc9b8d44f45f tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 404 len: 111 microversion: 2.20 time: 0.030101 Jul 14 16:14:13.542106 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 696/1389] 10.222.0.119 () {60 vars in 1284 bytes} [Thu Jul 14 16:14:13 2022] DELETE /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:14:13.545807 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:13.546486 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: fda75890-b40a-46df-8cce-6881fe48b132] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:13.553572 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:13.554046 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:13.554798 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:13.555236 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:13.568669 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 HTTP/1.1 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:14:13.570270 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.572056 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': 'fda75890-b40a-46df-8cce-6881fe48b132'} Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:13.573209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. Jul 14 16:14:13.574938 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:13.576571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance fda75890-b40a-46df-8cce-6881fe48b132 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:13.576571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3bc204f1-203f-402b-bb06-21c77318592b tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132" status: 404 len: 111 microversion: 2.20 time: 0.030075 Jul 14 16:14:13.576571 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 694/1390] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:13 2022] GET /compute/v2.1/servers/fda75890-b40a-46df-8cce-6881fe48b132 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 16:14:14.871872 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:14.872403 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:14.878865 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:14.879315 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:14.880074 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:14.880536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:14.894239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 HTTP/1.1 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept: application/json Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Connection: close Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Length: 0 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Content-Type: application/json Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Host: 10.222.0.119 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Role: reader,member Jul 14 16:14:14.895773 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: method: > Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: exception: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.897579 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: action_args: {'id': '1556002e-581e-4aee-880d-f517f5513652'} Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:14.898635 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.900239 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.901866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:14.901866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f6cdad5-5abe-4549-a52a-9cbc99abc2f1 tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 404 len: 111 microversion: 2.20 time: 0.029126 Jul 14 16:14:14.901866 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 697/1391] 10.222.0.119 () {60 vars in 1284 bytes} [Thu Jul 14 16:14:14 2022] DELETE /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:14:14.905466 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:14.906209 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] [instance: 1556002e-581e-4aee-880d-f517f5513652] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:14.913287 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:14.913737 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:14.914501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:14.914935 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Lock "1cffebae-9f8f-471d-8503-434362f780eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:14.928080 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] HTTP exception thrown: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Request method failure captured: Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 HTTP/1.1 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept: application/json Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Connection: close Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Length: 0 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Content-Type: application/json Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Host: 10.222.0.119 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABi0D6pYtbg0naonvWal8xN8tKufBpHBrLMPPMRVAkb9iMncZHprRe88W2H_oJ0i3LUCYURPLVyndPikNhSbhNRbYiX8GBwisaBj4159zB7LF8HGIzFgvsXzbEx0Nguc0_aWA66DHOLxhJhenu_81DBmLC0UA8FyItAg7k1ZRE61nJDpGc Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Role: reader,member Jul 14 16:14:14.929603 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2/f50528750c0e4504aaafba1ebae3f707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119:8080/v1/AUTH_f50528750c0e4504aaafba1ebae3f707", "adminURL": "http://10.222.0.119:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.119/volume/v3/f50528750c0e4504aaafba1ebae3f707"}]}] Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Id: f50528750c0e4504aaafba1ebae3f707 Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1337530108 Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Id: 8874a26203f0408f8d8c9f26b2818b59 Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1337530108-project Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: method: > Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: exception: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.931357 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: action_args: {'id': '1556002e-581e-4aee-880d-f517f5513652'} Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:14.932394 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. Jul 14 16:14:14.934015 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Jul 14 16:14:14.935439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] Returning 404 to user: Instance 1556002e-581e-4aee-880d-f517f5513652 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:14.935439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a68de37-824a-480f-aee7-5320e2d6107a tempest-AttachVolumeShelveTestJSON-1337530108 tempest-AttachVolumeShelveTestJSON-1337530108-project] 10.222.0.119 "GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652" status: 404 len: 111 microversion: 2.20 time: 0.029330 Jul 14 16:14:14.935439 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 695/1392] 10.222.0.119 () {60 vars in 1281 bytes} [Thu Jul 14 16:14:14 2022] GET /compute/v2.1/servers/1556002e-581e-4aee-880d-f517f5513652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:14:55.958114 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:14:55.958744 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:15:28.741301 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:28.742085 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:36.638872 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:16:36.639598 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:17:08.057581 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:17:08.058199 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:17:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:12.591282 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:12.591971 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:15.967338 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:15.967826 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:18:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:16.840408 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:16.840967 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:48.749646 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:48.750161 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:19:56.648144 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:19:56.648920 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:20:28.065334 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:20:28.066019 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:21:32.600926 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:32.601536 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:21:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:21:35.975839 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:35.976501 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:21:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:21:36.849005 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:36.849440 dv-cinder-849869-1-iscsi devstack@n-api.service[125266]: Thu Jul 14 16:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:22:08.757751 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:22:08.758353 dv-cinder-849869-1-iscsi devstack@n-api.service[125267]: Thu Jul 14 16:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!